2024-01-23T06:55:38.084 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-23T06:55:38.084 DEBUG:teuthology.run:Teuthology command: teuthology --name lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} --archive /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433 --owner scheduled_lflores@teuthology --verbose -- /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433/orig.config.yaml 2024-01-23T06:55:38.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T06:55:38.213 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433 branch: wip-yuri7-testing-2024-01-18-1327 description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false job_id: '7527433' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri7-testing-2024-01-18-1327 ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 120 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request sha1: 1d1563036928048a487b8d17bdf66baca01c75bf valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: debuginfo: true flavor: default sha1: 1d1563036928048a487b8d17bdf66baca01c75bf thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri7-testing-2024-01-18-1327 sha1: 1d1563036928048a487b8d17bdf66baca01c75bf owner: scheduled_lflores@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 994 sha1: 1d1563036928048a487b8d17bdf66baca01c75bf sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri7-testing-2024-01-18-1327 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1d1563036928048a487b8d17bdf66baca01c75bf targets: smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9TEWxN1NGcMkFCTgCvj3qTbkRXD6fdhbu7qOmOtqmb3+jCmrHEDFlitH/mip68KBt3XQtS0M5RDAV6xyi5Mbk= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKm7cizsa8IsSxtJo3rYn0ZL1q4EpDm5/ATvaXoFsqnwlW5KKmqctKYU6EIxoIq83QCTCMz8oKx+93C4cJmu0w= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-22_23:24:57 tube: smithi user: lflores verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-23T06:55:38.214 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa; will attempt to use it 2024-01-23T06:55:38.214 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks 2024-01-23T06:55:38.215 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-23T06:55:38.216 INFO:teuthology.task.internal:Checking packages... 2024-01-23T06:55:38.239 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1d1563036928048a487b8d17bdf66baca01c75bf' 2024-01-23T06:55:38.239 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-23T06:55:38.240 INFO:teuthology.packaging:ref: None 2024-01-23T06:55:38.240 INFO:teuthology.packaging:tag: None 2024-01-23T06:55:38.240 INFO:teuthology.packaging:branch: wip-yuri7-testing-2024-01-18-1327 2024-01-23T06:55:38.240 INFO:teuthology.packaging:sha1: 1d1563036928048a487b8d17bdf66baca01c75bf 2024-01-23T06:55:38.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri7-testing-2024-01-18-1327 2024-01-23T06:55:38.414 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-779.g1d156303 2024-01-23T06:55:38.416 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-23T06:55:38.422 INFO:teuthology.task.internal:no buildpackages task found 2024-01-23T06:55:38.422 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-23T06:55:38.428 INFO:teuthology.task.internal:Saving configuration 2024-01-23T06:55:38.443 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-23T06:55:38.448 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T06:55:38.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 06:50:40.353073', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9TEWxN1NGcMkFCTgCvj3qTbkRXD6fdhbu7qOmOtqmb3+jCmrHEDFlitH/mip68KBt3XQtS0M5RDAV6xyi5Mbk='} 2024-01-23T06:55:38.497 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 06:50:40.351383', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKm7cizsa8IsSxtJo3rYn0ZL1q4EpDm5/ATvaXoFsqnwlW5KKmqctKYU6EIxoIq83QCTCMz8oKx+93C4cJmu0w='} 2024-01-23T06:55:38.497 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-23T06:55:38.504 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-01-23T06:55:38.504 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-01-23T06:55:38.504 INFO:teuthology.run_tasks:Running task console_log... 2024-01-23T06:55:38.580 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7effa7c74ee0>, signals=[15]) 2024-01-23T06:55:38.580 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-23T06:55:38.586 INFO:teuthology.task.internal:Opening connections... 2024-01-23T06:55:38.587 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T06:55:38.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:55:38.678 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T06:55:38.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:55:38.768 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-23T06:55:38.774 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-01-23T06:55:38.792 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-01-23T06:55:38.792 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-01-23T06:55:38.847 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-01-23T06:55:38.847 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="9" 2024-01-23T06:55:38.847 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-01-23T06:55:38.847 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="9" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el9" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:LOGO="fedora-logo-icon" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T06:55:38.848 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T06:55:38.849 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-01-23T06:55:38.872 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-01-23T06:55:38.890 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-01-23T06:55:38.890 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-01-23T06:55:38.947 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-01-23T06:55:38.947 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-23T06:55:38.948 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T06:55:38.949 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-01-23T06:55:38.971 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-23T06:55:38.980 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-23T06:55:38.991 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-23T06:55:38.991 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2024-01-23T06:55:38.994 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-01-23T06:55:39.010 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-23T06:55:39.016 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-23T06:55:39.016 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2024-01-23T06:55:39.047 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-01-23T06:55:39.148 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-23T06:55:39.208 INFO:teuthology.run_tasks:Running task kernel... 2024-01-23T06:55:39.222 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-01-23T06:55:39.222 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-01-23T06:55:39.222 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-23T06:55:39.223 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-23T06:55:39.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T06:55:39.239 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-01-23T06:55:39.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T06:55:39.240 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-01-23T06:55:39.294 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-361.el9.x86_64 2024-01-23T06:55:39.294 INFO:teuthology.task.kernel:Running kernel on smithi116: 5.14.0-361.el9.x86_64 2024-01-23T06:55:39.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2024-01-23T06:55:39.297 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-361.el9.x86_64 2024-01-23T06:55:39.297 INFO:teuthology.task.kernel:Running kernel on smithi173: 5.14.0-361.el9.x86_64 2024-01-23T06:55:39.297 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2024-01-23T06:55:41.581 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 12 MB/s | 7.8 MB 00:00 2024-01-23T06:55:41.607 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - AppStream 12 MB/s | 7.8 MB 00:00 2024-01-23T06:55:43.199 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.5 MB 00:00 2024-01-23T06:55:43.214 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.5 MB 00:00 2024-01-23T06:55:44.056 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-01-23T06:55:45.791 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-01-23T06:55:46.413 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.0 MB 00:02 2024-01-23T06:55:51.675 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 5.9 MB 00:02 2024-01-23T06:55:53.292 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2024-01-23T06:55:54.310 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2024-01-23T06:55:55.555 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 19 MB 00:08 2024-01-23T06:55:59.310 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-01-23T06:55:59.722 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 5.9 MB 00:00 2024-01-23T06:56:01.298 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T06:56:01.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T06:56:01.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.475 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.476 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.477 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.478 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T06:56:01.479 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.480 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T06:56:01.817 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-23T06:56:01.817 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-23T06:56:01.919 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 5.14.0-410.el9 baseos 6.0 M 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 5.14.0-410.el9 baseos 21 M 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 5.14.0-410.el9 baseos 39 M 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core x86_64 5.14.0-410.el9 baseos 33 M 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T06:56:01.931 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T06:56:01.932 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T06:56:01.932 INFO:teuthology.orchestra.run.smithi116.stdout:Install 4 Packages 2024-01-23T06:56:01.932 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T06:56:01.932 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 99 M 2024-01-23T06:56:01.932 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 122 M 2024-01-23T06:56:01.933 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T06:56:02.269 INFO:teuthology.orchestra.run.smithi116.stdout:(1/4): kernel-5.14.0-410.el9.x86_64.rpm 20 MB/s | 6.0 MB 00:00 2024-01-23T06:56:02.603 INFO:teuthology.orchestra.run.smithi116.stdout:(2/4): kernel-core-5.14.0-410.el9.x86_64.rpm 33 MB/s | 21 MB 00:00 2024-01-23T06:56:02.974 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2024-01-23T06:56:03.128 INFO:teuthology.orchestra.run.smithi116.stdout:(3/4): kernel-modules-5.14.0-410.el9.x86_64.rpm 34 MB/s | 39 MB 00:01 2024-01-23T06:56:03.446 INFO:teuthology.orchestra.run.smithi116.stdout:(4/4): kernel-modules-core-5.14.0-410.el9.x86_6 28 MB/s | 33 MB 00:01 2024-01-23T06:56:03.447 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T06:56:03.447 INFO:teuthology.orchestra.run.smithi116.stdout:Total 66 MB/s | 99 MB 00:01 2024-01-23T06:56:04.329 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T06:56:04.673 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T06:56:04.673 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T06:56:06.298 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T06:56:06.298 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T06:56:07.957 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-01-23T06:56:09.181 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T06:56:09.833 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-core-5.14.0-410.el9.x86_64 1/4 2024-01-23T06:56:09.953 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-5.14.0-410.el9.x86_64 2/4 2024-01-23T06:56:10.122 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T06:56:10.122 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T06:56:10.122 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T06:56:10.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.123 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T06:56:10.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.123 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T06:56:10.123 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.123 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.124 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T06:56:10.125 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.126 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T06:56:10.126 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.126 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T06:56:10.126 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.126 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T06:56:10.126 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.126 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.127 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T06:56:10.128 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.128 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T06:56:10.128 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.128 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T06:56:10.128 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.128 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T06:56:10.128 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.129 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.130 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T06:56:10.556 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-23T06:56:10.556 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-23T06:56:10.666 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T06:56:10.675 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T06:56:10.676 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-01-23T06:56:10.676 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T06:56:10.676 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T06:56:10.676 INFO:teuthology.orchestra.run.smithi173.stdout: kernel x86_64 5.14.0-410.el9 baseos 6.0 M 2024-01-23T06:56:10.676 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T06:56:10.677 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core x86_64 5.14.0-410.el9 baseos 21 M 2024-01-23T06:56:10.677 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules x86_64 5.14.0-410.el9 baseos 39 M 2024-01-23T06:56:10.677 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core x86_64 5.14.0-410.el9 baseos 33 M 2024-01-23T06:56:10.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T06:56:10.677 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T06:56:10.677 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T06:56:10.677 INFO:teuthology.orchestra.run.smithi173.stdout:Install 4 Packages 2024-01-23T06:56:10.678 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T06:56:10.678 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 99 M 2024-01-23T06:56:10.678 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 122 M 2024-01-23T06:56:10.678 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T06:56:11.217 INFO:teuthology.orchestra.run.smithi173.stdout:(1/4): kernel-5.14.0-410.el9.x86_64.rpm 22 MB/s | 6.0 MB 00:00 2024-01-23T06:56:11.559 INFO:teuthology.orchestra.run.smithi173.stdout:(2/4): kernel-core-5.14.0-410.el9.x86_64.rpm 34 MB/s | 21 MB 00:00 2024-01-23T06:56:12.092 INFO:teuthology.orchestra.run.smithi173.stdout:(3/4): kernel-modules-5.14.0-410.el9.x86_64.rpm 34 MB/s | 39 MB 00:01 2024-01-23T06:56:12.409 INFO:teuthology.orchestra.run.smithi173.stdout:(4/4): kernel-modules-core-5.14.0-410.el9.x86_6 28 MB/s | 33 MB 00:01 2024-01-23T06:56:12.410 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T06:56:12.410 INFO:teuthology.orchestra.run.smithi173.stdout:Total 57 MB/s | 99 MB 00:01 2024-01-23T06:56:12.704 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-410.el9.x86_64 2/4 2024-01-23T06:56:12.881 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-5.14.0-410.el9.x86_64 3/4 2024-01-23T06:56:13.293 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T06:56:13.682 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T06:56:13.682 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T06:56:15.412 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T06:56:15.412 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T06:56:17.584 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-410.el9.x86_64 3/4 2024-01-23T06:56:17.774 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:18.330 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T06:56:18.991 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-core-5.14.0-410.el9.x86_64 1/4 2024-01-23T06:56:19.118 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-core-5.14.0-410.el9.x86_64 2/4 2024-01-23T06:56:21.886 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-410.el9.x86_64 2/4 2024-01-23T06:56:22.079 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-5.14.0-410.el9.x86_64 3/4 2024-01-23T06:56:22.522 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-core-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:26.801 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-410.el9.x86_64 3/4 2024-01-23T06:56:26.988 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:31.711 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-core-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:51.470 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:51.471 INFO:teuthology.orchestra.run.smithi116.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-23T06:56:51.471 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T06:56:51.555 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:52.013 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-5.14.0-410.el9.x86_64 1/4 2024-01-23T06:56:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-5.14.0-410.el9.x86_64 2/4 2024-01-23T06:56:52.014 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-5.14.0-410.el9.x86_64 3/4 2024-01-23T06:56:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-core-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:56:52.500 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T06:56:52.500 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T06:56:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-5.14.0-410.el9.x86_64 2024-01-23T06:56:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core-5.14.0-410.el9.x86_64 2024-01-23T06:56:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-5.14.0-410.el9.x86_64 2024-01-23T06:56:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-core-5.14.0-410.el9.x86_64 2024-01-23T06:56:52.501 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T06:56:52.501 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T06:56:53.004 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-01-23T06:56:53.162 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-410.el9.x86_64 2024-01-23T06:56:53.163 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-410.el9.x86_64 2024-01-23T06:56:53.163 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-410.el9.x86_64 2024-01-23T06:56:53.163 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-23T06:56:53.163 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-23T06:56:53.163 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-01-23T06:56:53.163 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2024-01-23T06:56:53.163 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel | sort -rV | head -n 1 2024-01-23T06:56:53.284 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-5.14.0-410.el9.x86_64 2024-01-23T06:56:53.284 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-410.el9.x86_64 2024-01-23T06:56:53.284 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2024-01-23T06:56:53.325 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2024-01-23T06:56:53.325 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2024-01-23T06:56:53.325 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.06 2024-01-23T06:56:53.325 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 68.el9 2024-01-23T06:56:53.325 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2024-01-23T06:56:53.325 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-23T06:56:53.325 INFO:teuthology.orchestra.run.smithi116.stdout:Group : Unspecified 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 8264254 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : builder@centos.org 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-23T06:56:53.326 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-23T06:56:53.327 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-23T06:56:53.327 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2024-01-23T06:56:53.327 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T06:56:53.327 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2024-01-23T06:56:53.328 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-23T06:56:53.328 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 5.14.0-410.el9.x86_64 2024-01-23T06:56:53.328 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-23T06:56:53.922 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2024-01-23T06:56:55.270 INFO:teuthology.orchestra.run.smithi116.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-23T06:56:55.305 INFO:teuthology.orchestra.run.smithi116.stderr:done 2024-01-23T06:56:55.307 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2024-01-23T06:56:55.322 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.nOTheBIaSZ 2024-01-23T06:56:55.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nOTheBIaSZ 2024-01-23T06:56:55.391 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.nOTheBIaSZ 2024-01-23T06:56:55.534 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.nOTheBIaSZ is 6KB 2024-01-23T06:56:55.583 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.nOTheBIaSZ 2024-01-23T06:56:55.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2024-01-23T06:56:55.662 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-23T06:56:55.662 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-23T06:56:55.662 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-23T06:56:55.662 INFO:teuthology.orchestra.run.smithi116.stdout:15949e3c88704300882482eddfd7baae-5.14.0-410.el9.x86_64.conf 2024-01-23T06:56:55.664 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-410.el9.x86_64 2024-01-23T06:56:55.812 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2024-01-23T06:57:00.788 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:57:00.789 INFO:teuthology.orchestra.run.smithi173.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-23T06:57:00.789 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T06:57:00.874 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:57:01.350 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:57:01.350 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-5.14.0-410.el9.x86_64 1/4 2024-01-23T06:57:01.351 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-core-5.14.0-410.el9.x86_64 2/4 2024-01-23T06:57:01.351 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-5.14.0-410.el9.x86_64 3/4 2024-01-23T06:57:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-core-5.14.0-410.el9.x86_64 4/4 2024-01-23T06:57:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T06:57:01.765 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T06:57:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-5.14.0-410.el9.x86_64 2024-01-23T06:57:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core-5.14.0-410.el9.x86_64 2024-01-23T06:57:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-5.14.0-410.el9.x86_64 2024-01-23T06:57:01.765 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-core-5.14.0-410.el9.x86_64 2024-01-23T06:57:01.766 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T06:57:01.766 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T06:57:02.267 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-01-23T06:57:02.415 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-410.el9.x86_64 2024-01-23T06:57:02.415 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-410.el9.x86_64 2024-01-23T06:57:02.415 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-410.el9.x86_64 2024-01-23T06:57:02.415 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-23T06:57:02.415 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-23T06:57:02.415 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-01-23T06:57:02.415 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2024-01-23T06:57:02.415 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2024-01-23T06:57:02.538 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-5.14.0-410.el9.x86_64 2024-01-23T06:57:02.538 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-410.el9.x86_64 2024-01-23T06:57:02.538 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2024-01-23T06:57:02.581 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2024-01-23T06:57:02.581 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2024-01-23T06:57:02.581 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.06 2024-01-23T06:57:02.581 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 68.el9 2024-01-23T06:57:02.581 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2024-01-23T06:57:02.581 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-23T06:57:02.581 INFO:teuthology.orchestra.run.smithi173.stdout:Group : Unspecified 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 8264254 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : builder@centos.org 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-23T06:57:02.582 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-23T06:57:02.583 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2024-01-23T06:57:02.583 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T06:57:02.583 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2024-01-23T06:57:02.584 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-23T06:57:02.584 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 5.14.0-410.el9.x86_64 2024-01-23T06:57:02.584 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-23T06:57:03.211 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-01-23T06:57:04.531 INFO:teuthology.orchestra.run.smithi173.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-23T06:57:04.565 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-01-23T06:57:04.568 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-01-23T06:57:04.583 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.Ah7MpVuJt7 2024-01-23T06:57:04.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ah7MpVuJt7 2024-01-23T06:57:04.652 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.Ah7MpVuJt7 2024-01-23T06:57:04.811 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.Ah7MpVuJt7 is 6KB 2024-01-23T06:57:04.859 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.Ah7MpVuJt7 2024-01-23T06:57:04.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2024-01-23T06:57:04.938 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-23T06:57:04.938 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-23T06:57:04.938 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-23T06:57:04.939 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-410.el9.x86_64.conf 2024-01-23T06:57:04.940 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-410.el9.x86_64 2024-01-23T06:57:05.093 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-01-23T06:57:25.832 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-01-23T06:57:25.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-23T06:57:25.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:57:35.106 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-01-23T06:57:35.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-23T06:57:35.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:25.885 DEBUG:teuthology.orchestra.remote:timed out 2024-01-23T06:58:34.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-23T06:58:34.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:35.109 DEBUG:teuthology.orchestra.remote:timed out 2024-01-23T06:58:35.395 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-01-23T06:58:35.774 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-23T06:58:35.774 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-410.el9.x86_64"... 2024-01-23T06:58:35.775 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2024-01-23T06:58:35.789 INFO:teuthology.orchestra.run.smithi116.stdout:5.14.0-410.el9.x86_64 2024-01-23T06:58:35.789 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-410.el9.x86_64 vs 5.14.0-410.el9.x86_64 2024-01-23T06:58:35.789 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-23T06:58:35.789 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-23T06:58:36.790 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-01-23T06:58:36.790 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-23T06:58:36.854 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2024-01-23T06:58:36.900 DEBUG:teuthology.parallel:result is None 2024-01-23T06:58:44.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-23T06:58:44.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T06:58:51.675 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-01-23T06:58:52.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-23T06:58:52.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-410.el9.x86_64"... 2024-01-23T06:58:52.112 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-01-23T06:58:52.126 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-410.el9.x86_64 2024-01-23T06:58:52.126 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-410.el9.x86_64 vs 5.14.0-410.el9.x86_64 2024-01-23T06:58:52.126 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-23T06:58:52.126 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-23T06:58:53.127 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-01-23T06:58:53.128 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-01-23T06:58:53.328 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-01-23T06:58:53.363 DEBUG:teuthology.parallel:result is None 2024-01-23T06:58:53.364 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-23T06:58:53.371 INFO:teuthology.task.internal:Creating test directory... 2024-01-23T06:58:53.371 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-23T06:58:53.374 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-23T06:58:53.390 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-23T06:58:53.459 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-23T06:58:53.587 INFO:teuthology.task.internal:Creating archive directory... 2024-01-23T06:58:53.587 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-23T06:58:53.589 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-23T06:58:53.708 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-23T06:58:53.716 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-23T06:58:53.716 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-23T06:58:53.721 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-23T06:58:53.748 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T06:58:53.751 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T06:58:53.761 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T06:58:53.765 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-23T06:58:53.767 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-23T06:58:53.774 INFO:teuthology.task.internal:Configuring sudo... 2024-01-23T06:58:53.774 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-23T06:58:53.809 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-23T06:58:53.837 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-23T06:58:53.846 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-23T06:58:53.847 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-23T06:58:53.880 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-23T06:58:53.894 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-23T06:58:53.979 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-23T06:58:54.023 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-23T06:58:54.104 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-23T06:58:54.147 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T06:58:54.147 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-23T06:58:54.214 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-23T06:58:54.257 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-23T06:58:54.323 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-23T06:58:54.360 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-23T06:58:54.411 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T06:58:54.411 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-23T06:58:54.481 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2024-01-23T06:58:54.484 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-01-23T06:58:54.541 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-23T06:58:54.786 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-23T06:58:55.379 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-23T06:58:55.388 INFO:teuthology.task.internal:Starting timer... 2024-01-23T06:58:55.388 INFO:teuthology.run_tasks:Running task pcp... 2024-01-23T06:58:55.398 INFO:teuthology.run_tasks:Running task selinux... 2024-01-23T06:58:55.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2024-01-23T06:58:55.473 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2024-01-23T06:58:55.475 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-01-23T06:58:55.574 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-01-23T06:58:55.578 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-23T06:58:55.578 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2024-01-23T06:58:55.599 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2024-01-23T06:58:55.600 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-01-23T06:58:55.643 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-01-23T06:58:55.643 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi116.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-01-23T06:58:55.644 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-23T06:58:55.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T06:58:55.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-23T06:58:55.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T06:58:55.736 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-23T06:58:55.736 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2024-01-23T06:58:55.768 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-01-23T06:58:55.809 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-23T06:58:55.819 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-23T06:58:55.836 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-23T06:58:55.837 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi116.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-23T07:11:53.975 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi116.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-01-23T07:11:53.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-23T07:11:53.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T07:11:54.066 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-01-23T07:11:54.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-23T07:11:54.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-23T07:11:54.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T07:11:54.236 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-01-23T07:11:54.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-01-23T07:11:54.312 INFO:teuthology.run_tasks:Running task clock... 2024-01-23T07:11:54.325 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-23T07:11:54.326 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-23T07:11:54.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T07:11:54.329 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-23T07:11:54.329 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T07:11:54.359 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-23T07:11:54.373 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-23T07:11:54.383 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-23T07:11:54.400 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-23T07:11:54.401 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2024-01-23T07:11:54.415 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2024-01-23T07:11:54.429 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-01-23T07:11:54.431 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-23T07:11:54.442 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-01-23T07:11:54.448 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-23T07:11:54.458 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-23T07:11:54.474 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-23T07:11:54.502 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-01-23T07:11:54.506 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-23T07:11:54.506 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-01-23T07:11:54.506 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.507 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.507 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.507 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.528 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-01-23T07:11:54.531 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-23T07:11:54.531 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-01-23T07:11:54.531 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.531 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.531 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.531 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T07:11:54.532 INFO:teuthology.run_tasks:Running task install... 2024-01-23T07:11:54.541 DEBUG:teuthology.task.install:project ceph 2024-01-23T07:11:54.542 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf'}} 2024-01-23T07:11:54.542 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf'} 2024-01-23T07:11:54.542 INFO:teuthology.task.install:Using flavor: default 2024-01-23T07:11:54.548 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-01-23T07:11:54.548 INFO:teuthology.task.install:extra packages: [] 2024-01-23T07:11:54.549 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf', 'tag': None, 'wait_for_package': False} 2024-01-23T07:11:54.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d1563036928048a487b8d17bdf66baca01c75bf 2024-01-23T07:11:54.551 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf', 'tag': None, 'wait_for_package': False} 2024-01-23T07:11:54.552 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d1563036928048a487b8d17bdf66baca01c75bf 2024-01-23T07:11:54.697 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/ 2024-01-23T07:11:54.697 INFO:teuthology.task.install.rpm:Package version is 19.0.0-779.g1d156303 2024-01-23T07:11:54.810 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/ 2024-01-23T07:11:54.810 INFO:teuthology.task.install.rpm:Package version is 19.0.0-779.g1d156303 2024-01-23T07:11:54.893 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-23T07:11:54.893 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:11:54.894 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-23T07:11:54.920 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri7-testing-2024-01-18-1327/1d1563036928048a487b8d17bdf66baca01c75bf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-23T07:11:54.920 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:11:54.920 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-23T07:11:54.922 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-01-23T07:11:54.922 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d1563036928048a487b8d17bdf66baca01c75bf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-23T07:11:54.949 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2024-01-23T07:11:54.950 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d1563036928048a487b8d17bdf66baca01c75bf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-23T07:11:54.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-23T07:11:55.057 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-23T07:11:55.071 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-23T07:11:55.137 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-23T07:11:55.137 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2024-01-23T07:11:55.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2024-01-23T07:11:55.203 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-01-23T07:11:55.205 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-01-23T07:11:55.400 INFO:teuthology.orchestra.run.smithi116.stdout:73 files removed 2024-01-23T07:11:55.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw 2024-01-23T07:11:55.460 INFO:teuthology.orchestra.run.smithi173.stdout:73 files removed 2024-01-23T07:11:55.490 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw 2024-01-23T07:11:56.061 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 251 kB/s | 80 kB 00:00 2024-01-23T07:11:56.199 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 205 kB/s | 80 kB 00:00 2024-01-23T07:11:56.487 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2024-01-23T07:11:56.591 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 28 kB/s | 9.5 kB 00:00 2024-01-23T07:11:56.854 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-01-23T07:11:56.942 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-01-23T07:11:57.465 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - AppStream 14 MB/s | 7.8 MB 00:00 2024-01-23T07:11:57.944 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 8.1 MB/s | 7.8 MB 00:00 2024-01-23T07:11:59.174 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.5 MB 00:00 2024-01-23T07:11:59.578 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.5 MB 00:00 2024-01-23T07:12:00.165 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-01-23T07:12:00.488 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-01-23T07:12:02.462 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-01-23T07:12:08.912 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 5.9 MB 00:02 2024-01-23T07:12:10.496 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2024-01-23T07:12:14.307 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 19 MB 00:12 2024-01-23T07:12:18.382 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.9 MB 00:00 2024-01-23T07:12:20.008 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2024-01-23T07:12:22.987 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 7.2 MB/s | 20 MB 00:02 2024-01-23T07:12:28.034 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-01-23T07:12:30.522 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:12:30.522 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:12:30.522 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:12:30.522 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.522 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:12:30.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:12:30.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:12:31.071 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:12:31.081 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:12:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:12:31.081 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:12:31.081 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:12:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:19.0.0-779.g1d156303.el9 ceph 8.6 M 2024-01-23T07:12:31.081 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2024-01-23T07:12:31.081 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:19.0.0-779.g1d156303.el9 ceph 3.4 M 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:19.0.0-779.g1d156303.el9 ceph 3.1 M 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:19.0.0-779.g1d156303.el9 ceph 5.1 M 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:19.0.0-779.g1d156303.el9 ceph 19 M 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:19.0.0-779.g1d156303.el9 ceph 25 k 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:19.0.0-779.g1d156303.el9 ceph 742 k 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-01-23T07:12:31.082 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:19.0.0-779.g1d156303.el9 ceph 499 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:19.0.0-779.g1d156303.el9 ceph 4.8 M 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:19.0.0-779.g1d156303.el9 ceph 45 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:19.0.0-779.g1d156303.el9 ceph 130 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:19.0.0-779.g1d156303.el9 ceph 161 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:19.0.0-779.g1d156303.el9 ceph 321 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:19.0.0-779.g1d156303.el9 ceph 298 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:19.0.0-779.g1d156303.el9 ceph 99 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-23T07:12:31.083 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-23T07:12:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:12:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:12:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:12:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:Install 27 Packages 2024-01-23T07:12:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 2 Packages 2024-01-23T07:12:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:12:31.085 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 55 M 2024-01-23T07:12:31.085 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:12:32.585 INFO:teuthology.orchestra.run.smithi116.stdout:(1/29): ceph-common-19.0.0-779.g1d156303.el9.x8 15 MB/s | 19 MB 00:01 2024-01-23T07:12:32.635 INFO:teuthology.orchestra.run.smithi116.stdout:(2/29): ceph-selinux-19.0.0-779.g1d156303.el9.x 506 kB/s | 25 kB 00:00 2024-01-23T07:12:32.711 INFO:teuthology.orchestra.run.smithi116.stdout:(3/29): libcephfs2-19.0.0-779.g1d156303.el9.x86 9.7 MB/s | 742 kB 00:00 2024-01-23T07:12:32.769 INFO:teuthology.orchestra.run.smithi116.stdout:(4/29): libradosstriper1-19.0.0-779.g1d156303.e 8.4 MB/s | 499 kB 00:00 2024-01-23T07:12:33.045 INFO:teuthology.orchestra.run.smithi116.stdout:(5/29): librgw2-19.0.0-779.g1d156303.el9.x86_64 17 MB/s | 4.8 MB 00:00 2024-01-23T07:12:33.087 INFO:teuthology.orchestra.run.smithi116.stdout:(6/29): python3-ceph-argparse-19.0.0-779.g1d156 1.1 MB/s | 45 kB 00:00 2024-01-23T07:12:33.129 INFO:teuthology.orchestra.run.smithi116.stdout:(7/29): python3-ceph-common-19.0.0-779.g1d15630 3.0 MB/s | 130 kB 00:00 2024-01-23T07:12:33.179 INFO:teuthology.orchestra.run.smithi116.stdout:(8/29): python3-cephfs-19.0.0-779.g1d156303.el9 3.2 MB/s | 161 kB 00:00 2024-01-23T07:12:33.238 INFO:teuthology.orchestra.run.smithi116.stdout:(9/29): python3-rados-19.0.0-779.g1d156303.el9. 5.4 MB/s | 321 kB 00:00 2024-01-23T07:12:33.288 INFO:teuthology.orchestra.run.smithi116.stdout:(10/29): python3-rbd-19.0.0-779.g1d156303.el9.x 5.8 MB/s | 298 kB 00:00 2024-01-23T07:12:33.338 INFO:teuthology.orchestra.run.smithi116.stdout:(11/29): python3-rgw-19.0.0-779.g1d156303.el9.x 1.9 MB/s | 99 kB 00:00 2024-01-23T07:12:33.423 INFO:teuthology.orchestra.run.smithi116.stdout:(12/29): ceph-base-19.0.0-779.g1d156303.el9.x86 2.4 MB/s | 5.1 MB 00:02 2024-01-23T07:12:33.539 INFO:teuthology.orchestra.run.smithi116.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 534 kB/s | 107 kB 00:00 2024-01-23T07:12:33.564 INFO:teuthology.orchestra.run.smithi116.stdout:(14/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-01-23T07:12:33.590 INFO:teuthology.orchestra.run.smithi116.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-01-23T07:12:33.656 INFO:teuthology.orchestra.run.smithi116.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-01-23T07:12:33.682 INFO:teuthology.orchestra.run.smithi116.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-01-23T07:12:33.699 INFO:teuthology.orchestra.run.smithi116.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-01-23T07:12:34.432 INFO:teuthology.orchestra.run.smithi116.stdout:(19/29): ceph-radosgw-19.0.0-779.g1d156303.el9. 2.8 MB/s | 8.6 MB 00:03 2024-01-23T07:14:45.242 INFO:teuthology.orchestra.run.smithi116.stdout:[MIRROR] gperftools-libs-2.9.1-2.el9.x86_64.rpm: Curl error (28): Timeout was reached for https://epel.mirror.shastacoe.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-2.el9.x86_64.rpm [Failed to connect to epel.mirror.shastacoe.net port 443: Connection timed out] 2024-01-23T07:14:45.243 INFO:teuthology.orchestra.run.smithi116.stdout:[MIRROR] libarrow-9.0.0-10.el9.x86_64.rpm: Curl error (28): Timeout was reached for https://epel.mirror.shastacoe.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-10.el9.x86_64.rpm [Failed to connect to epel.mirror.shastacoe.net port 443: Connection timed out] 2024-01-23T07:14:45.243 INFO:teuthology.orchestra.run.smithi116.stdout:[MIRROR] libarrow-doc-9.0.0-10.el9.noarch.rpm: Curl error (28): Timeout was reached for https://epel.mirror.shastacoe.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-10.el9.noarch.rpm [Failed to connect to epel.mirror.shastacoe.net port 443: Connection timed out] 2024-01-23T07:16:36.248 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 78 kB/s | 20 MB 04:25 2024-01-23T07:16:41.186 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-01-23T07:16:43.655 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:16:43.655 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:16:43.655 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:16:43.655 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:16:43.656 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.657 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:16:43.658 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.659 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:16:43.660 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:16:43.661 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.662 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.663 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:16:43.664 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:16:43.665 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:16:44.169 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:19.0.0-779.g1d156303.el9 ceph 8.6 M 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:19.0.0-779.g1d156303.el9 ceph 3.4 M 2024-01-23T07:16:44.176 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:19.0.0-779.g1d156303.el9 ceph 3.1 M 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:19.0.0-779.g1d156303.el9 ceph 5.1 M 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:19.0.0-779.g1d156303.el9 ceph 19 M 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:19.0.0-779.g1d156303.el9 ceph 25 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:19.0.0-779.g1d156303.el9 ceph 742 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:19.0.0-779.g1d156303.el9 ceph 499 k 2024-01-23T07:16:44.177 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:19.0.0-779.g1d156303.el9 ceph 4.8 M 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:19.0.0-779.g1d156303.el9 ceph 45 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:19.0.0-779.g1d156303.el9 ceph 130 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:19.0.0-779.g1d156303.el9 ceph 161 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:19.0.0-779.g1d156303.el9 ceph 321 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:19.0.0-779.g1d156303.el9 ceph 298 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:19.0.0-779.g1d156303.el9 ceph 99 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-23T07:16:44.178 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:16:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:16:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:16:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:Install 27 Packages 2024-01-23T07:16:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 2 Packages 2024-01-23T07:16:44.179 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:16:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 55 M 2024-01-23T07:16:44.179 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:16:45.062 INFO:teuthology.orchestra.run.smithi173.stdout:(1/29): ceph-radosgw-19.0.0-779.g1d156303.el9.x 13 MB/s | 8.6 MB 00:00 2024-01-23T07:16:45.095 INFO:teuthology.orchestra.run.smithi173.stdout:(2/29): ceph-selinux-19.0.0-779.g1d156303.el9.x 761 kB/s | 25 kB 00:00 2024-01-23T07:16:45.170 INFO:teuthology.orchestra.run.smithi173.stdout:(3/29): libcephfs2-19.0.0-779.g1d156303.el9.x86 9.7 MB/s | 742 kB 00:00 2024-01-23T07:16:45.229 INFO:teuthology.orchestra.run.smithi173.stdout:(4/29): libradosstriper1-19.0.0-779.g1d156303.e 8.4 MB/s | 499 kB 00:00 2024-01-23T07:16:45.496 INFO:teuthology.orchestra.run.smithi173.stdout:(5/29): librgw2-19.0.0-779.g1d156303.el9.x86_64 18 MB/s | 4.8 MB 00:00 2024-01-23T07:16:45.530 INFO:teuthology.orchestra.run.smithi173.stdout:(6/29): python3-ceph-argparse-19.0.0-779.g1d156 1.3 MB/s | 45 kB 00:00 2024-01-23T07:16:45.571 INFO:teuthology.orchestra.run.smithi173.stdout:(7/29): python3-ceph-common-19.0.0-779.g1d15630 3.1 MB/s | 130 kB 00:00 2024-01-23T07:16:45.622 INFO:teuthology.orchestra.run.smithi173.stdout:(8/29): python3-cephfs-19.0.0-779.g1d156303.el9 3.1 MB/s | 161 kB 00:00 2024-01-23T07:16:45.672 INFO:teuthology.orchestra.run.smithi173.stdout:(9/29): python3-rados-19.0.0-779.g1d156303.el9. 6.3 MB/s | 321 kB 00:00 2024-01-23T07:16:45.722 INFO:teuthology.orchestra.run.smithi173.stdout:(10/29): python3-rbd-19.0.0-779.g1d156303.el9.x 5.8 MB/s | 298 kB 00:00 2024-01-23T07:16:45.764 INFO:teuthology.orchestra.run.smithi173.stdout:(11/29): python3-rgw-19.0.0-779.g1d156303.el9.x 2.3 MB/s | 99 kB 00:00 2024-01-23T07:16:46.081 INFO:teuthology.orchestra.run.smithi173.stdout:(12/29): ceph-base-19.0.0-779.g1d156303.el9.x86 3.0 MB/s | 5.1 MB 00:01 2024-01-23T07:16:46.198 INFO:teuthology.orchestra.run.smithi173.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 246 kB/s | 107 kB 00:00 2024-01-23T07:16:46.299 INFO:teuthology.orchestra.run.smithi173.stdout:(14/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-01-23T07:16:46.507 INFO:teuthology.orchestra.run.smithi173.stdout:(15/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 377 kB/s | 160 kB 00:00 2024-01-23T07:16:46.649 INFO:teuthology.orchestra.run.smithi173.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-01-23T07:16:46.691 INFO:teuthology.orchestra.run.smithi173.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-01-23T07:16:46.758 INFO:teuthology.orchestra.run.smithi173.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 389 kB/s | 42 kB 00:00 2024-01-23T07:16:46.825 INFO:teuthology.orchestra.run.smithi173.stdout:(19/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 2.3 MB/s | 309 kB 00:00 2024-01-23T07:16:46.958 INFO:teuthology.orchestra.run.smithi173.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-01-23T07:16:47.000 INFO:teuthology.orchestra.run.smithi173.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-01-23T07:16:47.042 INFO:teuthology.orchestra.run.smithi173.stdout:(22/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-01-23T07:16:47.109 INFO:teuthology.orchestra.run.smithi173.stdout:(23/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-01-23T07:16:47.176 INFO:teuthology.orchestra.run.smithi173.stdout:(24/29): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-01-23T07:16:47.201 INFO:teuthology.orchestra.run.smithi173.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-01-23T07:16:47.252 INFO:teuthology.orchestra.run.smithi173.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-01-23T07:16:47.444 INFO:teuthology.orchestra.run.smithi173.stdout:(27/29): ceph-common-19.0.0-779.g1d156303.el9.x 6.4 MB/s | 19 MB 00:03 2024-01-23T07:16:47.586 INFO:teuthology.orchestra.run.smithi173.stdout:(28/29): librbd1-19.0.0-779.g1d156303.el9.x86_6 9.4 MB/s | 3.1 MB 00:00 2024-01-23T07:16:47.902 INFO:teuthology.orchestra.run.smithi173.stdout:(29/29): librados2-19.0.0-779.g1d156303.el9.x86 4.8 MB/s | 3.4 MB 00:00 2024-01-23T07:16:47.905 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:16:47.905 INFO:teuthology.orchestra.run.smithi173.stdout:Total 15 MB/s | 55 MB 00:03 2024-01-23T07:16:47.973 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:16:48.006 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:16:48.007 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:16:48.467 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:16:48.467 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:16:49.821 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:16:49.913 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-01-23T07:16:49.941 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2024-01-23T07:16:49.999 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2024-01-23T07:16:50.320 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2024-01-23T07:16:50.373 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:19.0.0-779.g1d156303.el9.x86_64 5/31 2024-01-23T07:16:50.465 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:19.0.0-779.g1d156303.el9.x86_64 5/31 2024-01-23T07:16:50.551 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 6/31 2024-01-23T07:16:50.583 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 7/31 2024-01-23T07:16:50.654 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 7/31 2024-01-23T07:16:50.682 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2024-01-23T07:16:50.717 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:19.0.0-779.g1d156303.el9.x 9/31 2024-01-23T07:16:50.787 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 10/31 2024-01-23T07:16:50.810 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 11/31 2024-01-23T07:16:50.867 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 11/31 2024-01-23T07:16:50.974 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-01-23T07:16:51.018 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-01-23T07:16:51.060 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-01-23T07:16:51.101 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-01-23T07:16:51.130 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-01-23T07:16:51.163 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-01-23T07:16:51.476 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-01-23T07:16:51.501 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:19.0.0-779.g1d156303.el9.x86_64 19/31 2024-01-23T07:16:51.574 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:19.0.0-779.g1d156303.el9.x86_64 19/31 2024-01-23T07:16:51.606 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 20/31 2024-01-23T07:16:51.650 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-01-23T07:16:52.080 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-01-23T07:16:52.112 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:19.0.0-779.g1d156303.el9.x86_64 23/31 2024-01-23T07:16:52.183 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:19.0.0-779.g1d156303.el9.x86_64 23/31 2024-01-23T07:16:52.259 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 24/31 2024-01-23T07:16:52.289 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:19.0.0-779.g1d156303.el9.x86 25/31 2024-01-23T07:16:54.425 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 26/31 2024-01-23T07:16:54.461 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 26/31 2024-01-23T07:16:54.997 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 26/31 2024-01-23T07:16:55.040 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 27/31 2024-01-23T07:16:55.136 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 27/31 2024-01-23T07:16:55.136 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-23T07:16:55.136 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-23T07:16:55.136 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:16:55.166 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 28/31 2024-01-23T07:16:56.060 INFO:teuthology.orchestra.run.smithi116.stdout:[MIRROR] gperftools-libs-2.9.1-2.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://epel.mirror.shastacoe.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-2.el9.x86_64.rpm [Failed to connect to epel.mirror.shastacoe.net port 80: Connection timed out] 2024-01-23T07:16:56.060 INFO:teuthology.orchestra.run.smithi116.stdout:[MIRROR] libarrow-9.0.0-10.el9.x86_64.rpm: Curl error (28): Timeout was reached for http://epel.mirror.shastacoe.net/epel/9/Everything/x86_64/Packages/l/libarrow-9.0.0-10.el9.x86_64.rpm [Failed to connect to epel.mirror.shastacoe.net port 80: Connection timed out] 2024-01-23T07:16:56.060 INFO:teuthology.orchestra.run.smithi116.stdout:[MIRROR] libarrow-doc-9.0.0-10.el9.noarch.rpm: Curl error (28): Timeout was reached for http://epel.mirror.shastacoe.net/epel/9/Everything/x86_64/Packages/l/libarrow-doc-9.0.0-10.el9.noarch.rpm [Failed to connect to epel.mirror.shastacoe.net port 80: Connection timed out] 2024-01-23T07:16:56.388 INFO:teuthology.orchestra.run.smithi116.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 101 B/s | 26 kB 04:21 2024-01-23T07:16:56.564 INFO:teuthology.orchestra.run.smithi116.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 278 kB/s | 49 kB 00:00 2024-01-23T07:16:56.739 INFO:teuthology.orchestra.run.smithi116.stdout:(22/29): libunwind-1.6.2-1.el9.x86_64.rpm 385 kB/s | 67 kB 00:00 2024-01-23T07:16:56.856 INFO:teuthology.orchestra.run.smithi116.stdout:(23/29): libarrow-9.0.0-10.el9.x86_64.rpm 17 kB/s | 4.4 MB 04:23 2024-01-23T07:16:56.956 INFO:teuthology.orchestra.run.smithi116.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-01-23T07:16:57.073 INFO:teuthology.orchestra.run.smithi116.stdout:(25/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.5 MB/s | 838 kB 00:00 2024-01-23T07:16:57.115 INFO:teuthology.orchestra.run.smithi116.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-01-23T07:16:57.534 INFO:teuthology.orchestra.run.smithi116.stdout:(27/29): librados2-19.0.0-779.g1d156303.el9.x86 7.3 MB/s | 3.4 MB 00:00 2024-01-23T07:16:58.232 INFO:teuthology.orchestra.run.smithi116.stdout:(28/29): librbd1-19.0.0-779.g1d156303.el9.x86_6 2.9 MB/s | 3.1 MB 00:01 2024-01-23T07:17:04.541 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 28/31 2024-01-23T07:17:04.541 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-01-23T07:17:04.541 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-01-23T07:17:04.542 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-01-23T07:17:04.542 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-01-23T07:17:04.542 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-01-23T07:17:04.542 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-01-23T07:17:04.542 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-01-23T07:17:04.542 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:05.377 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 29/31 2024-01-23T07:17:05.401 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 29/31 2024-01-23T07:17:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:17:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-23T07:17:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-23T07:17:05.401 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-23T07:17:05.402 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:05.403 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-23T07:17:05.488 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-23T07:17:05.489 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-23T07:17:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-23T07:17:06.649 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 1/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 2/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 3/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 4/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 5/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 6/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:19.0.0-779.g1d156303.el9.x86_64 7/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:19.0.0-779.g1d156303.el9.x 8/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:19.0.0-779.g1d156303.el9.x86 9/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 10/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 11/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 12/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 13/31 2024-01-23T07:17:06.650 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-01-23T07:17:06.651 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-01-23T07:17:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-01-23T07:17:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-01-23T07:17:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-01-23T07:17:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-01-23T07:17:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:19.0.0-779.g1d156303.el9.x86_64 28/31 2024-01-23T07:17:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-01-23T07:17:06.652 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:19.0.0-779.g1d156303.el9.x86_64 30/31 2024-01-23T07:17:07.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-01-23T07:17:07.640 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:07.640 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-01-23T07:17:07.640 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.640 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.640 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:17:07.640 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-23T07:17:07.641 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-3.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:07.642 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:07.985 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test 2024-01-23T07:17:08.583 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:27 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.875 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:08.876 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.877 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:08.878 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:08.879 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:08.880 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.881 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.882 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.883 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:08.884 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.884 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.884 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.884 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:08.950 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:19.0.0-779.g1d156303.el9 ceph 46 M 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:19.0.0-779.g1d156303.el9 ceph 163 k 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-01-23T07:17:08.951 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-01-23T07:17:08.952 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-01-23T07:17:08.952 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:08.952 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:17:08.952 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:08.952 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-01-23T07:17:08.952 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:08.952 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 47 M 2024-01-23T07:17:08.953 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 201 M 2024-01-23T07:17:08.953 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:17:09.661 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): libcephsqlite-19.0.0-779.g1d156303.el9.x 367 kB/s | 163 kB 00:00 2024-01-23T07:17:09.769 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): jq-1.6-16.el9.x86_64.rpm 338 kB/s | 187 kB 00:00 2024-01-23T07:17:09.969 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-01-23T07:17:10.070 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 636 kB/s | 64 kB 00:00 2024-01-23T07:17:10.245 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 373 kB/s | 218 kB 00:00 2024-01-23T07:17:11.712 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): ceph-test-19.0.0-779.g1d156303.el9.x86_6 18 MB/s | 46 MB 00:02 2024-01-23T07:17:11.714 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:17:11.714 INFO:teuthology.orchestra.run.smithi173.stdout:Total 17 MB/s | 47 MB 00:02 2024-01-23T07:17:11.764 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:17:11.783 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:17:11.784 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:17:12.165 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:17:12.166 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:17:12.736 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:17:12.826 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-01-23T07:17:12.867 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-01-23T07:17:12.908 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-01-23T07:17:12.954 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-01-23T07:17:12.982 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 5/6 2024-01-23T07:17:17.344 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 5/6 2024-01-23T07:17:17.424 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 6/6 2024-01-23T07:17:19.817 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 6/6 2024-01-23T07:17:19.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 1/6 2024-01-23T07:17:19.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 2/6 2024-01-23T07:17:19.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-01-23T07:17:19.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-01-23T07:17:19.817 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-16.el9.x86_64 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-23T07:17:20.250 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-23T07:17:20.251 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-23T07:17:20.251 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:20.251 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:20.549 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph 2024-01-23T07:17:21.149 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:40 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:21.440 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:21.440 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:21.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:21.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:21.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:21.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.445 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.446 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:21.447 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:21.510 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:21.513 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:21.513 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:17:21.513 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:19.0.0-779.g1d156303.el9 ceph 6.5 k 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:19.0.0-779.g1d156303.el9 ceph 2.1 M 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.5 M 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 245 k 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:19.0.0-779.g1d156303.el9 ceph 4.7 M 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:19.0.0-779.g1d156303.el9 ceph 17 M 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-23T07:17:21.514 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-01-23T07:17:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-7.el9 baseos 124 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout:Install 36 Packages 2024-01-23T07:17:21.516 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:21.517 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 30 M 2024-01-23T07:17:21.517 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 106 M 2024-01-23T07:17:21.517 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:17:22.483 INFO:teuthology.orchestra.run.smithi173.stdout:(1/36): ceph-19.0.0-779.g1d156303.el9.x86_64.rp 28 kB/s | 6.5 kB 00:00 2024-01-23T07:17:22.617 INFO:teuthology.orchestra.run.smithi173.stdout:(2/36): ceph-mds-19.0.0-779.g1d156303.el9.x86_6 5.8 MB/s | 2.1 MB 00:00 2024-01-23T07:17:23.317 INFO:teuthology.orchestra.run.smithi173.stdout:(3/36): ceph-mgr-19.0.0-779.g1d156303.el9.x86_6 1.4 MB/s | 1.5 MB 00:01 2024-01-23T07:17:23.467 INFO:teuthology.orchestra.run.smithi173.stdout:(4/36): ceph-mgr-modules-core-19.0.0-779.g1d156 1.6 MB/s | 245 kB 00:00 2024-01-23T07:17:23.759 INFO:teuthology.orchestra.run.smithi173.stdout:(5/36): ceph-osd-19.0.0-779.g1d156303.el9.x86_6 15 MB/s | 17 MB 00:01 2024-01-23T07:17:23.818 INFO:teuthology.orchestra.run.smithi173.stdout:(6/36): ceph-mon-19.0.0-779.g1d156303.el9.x86_6 3.5 MB/s | 4.7 MB 00:01 2024-01-23T07:17:24.052 INFO:teuthology.orchestra.run.smithi173.stdout:(7/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 434 kB/s | 253 kB 00:00 2024-01-23T07:17:24.160 INFO:teuthology.orchestra.run.smithi173.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-01-23T07:17:24.235 INFO:teuthology.orchestra.run.smithi173.stdout:(9/36): python3-ply-3.11-14.el9.noarch.rpm 255 kB/s | 106 kB 00:00 2024-01-23T07:17:24.269 INFO:teuthology.orchestra.run.smithi173.stdout:(10/36): python3-requests-2.25.1-7.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2024-01-23T07:17:24.378 INFO:teuthology.orchestra.run.smithi173.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-01-23T07:17:24.420 INFO:teuthology.orchestra.run.smithi173.stdout:(12/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.1 MB/s | 215 kB 00:00 2024-01-23T07:17:24.504 INFO:teuthology.orchestra.run.smithi173.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-01-23T07:17:24.529 INFO:teuthology.orchestra.run.smithi173.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 319 kB/s | 35 kB 00:00 2024-01-23T07:17:24.621 INFO:teuthology.orchestra.run.smithi173.stdout:(15/36): python3-cryptography-36.0.1-4.el9.x86_ 1.4 MB/s | 1.2 MB 00:00 2024-01-23T07:17:24.646 INFO:teuthology.orchestra.run.smithi173.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 358 kB/s | 51 kB 00:00 2024-01-23T07:17:24.671 INFO:teuthology.orchestra.run.smithi173.stdout:(17/36): python3-toml-0.10.2-6.el9.noarch.rpm 293 kB/s | 42 kB 00:00 2024-01-23T07:17:24.722 INFO:teuthology.orchestra.run.smithi173.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-01-23T07:17:24.972 INFO:teuthology.orchestra.run.smithi173.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 145 kB/s | 43 kB 00:00 2024-01-23T07:17:25.047 INFO:teuthology.orchestra.run.smithi173.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 528 kB/s | 172 kB 00:00 2024-01-23T07:17:25.114 INFO:teuthology.orchestra.run.smithi173.stdout:(21/36): luarocks-3.9.2-1.el9.noarch.rpm 341 kB/s | 151 kB 00:00 2024-01-23T07:17:25.184 INFO:teuthology.orchestra.run.smithi173.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.7 MB/s | 358 kB 00:00 2024-01-23T07:17:25.198 INFO:teuthology.orchestra.run.smithi173.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 71 kB/s | 11 kB 00:00 2024-01-23T07:17:25.215 INFO:teuthology.orchestra.run.smithi173.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 176 kB/s | 18 kB 00:00 2024-01-23T07:17:25.240 INFO:teuthology.orchestra.run.smithi173.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 394 kB/s | 23 kB 00:00 2024-01-23T07:17:25.274 INFO:teuthology.orchestra.run.smithi173.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 329 kB/s | 19 kB 00:00 2024-01-23T07:17:25.291 INFO:teuthology.orchestra.run.smithi173.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-01-23T07:17:25.308 INFO:teuthology.orchestra.run.smithi173.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 685 kB/s | 46 kB 00:00 2024-01-23T07:17:25.342 INFO:teuthology.orchestra.run.smithi173.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-01-23T07:17:25.367 INFO:teuthology.orchestra.run.smithi173.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-01-23T07:17:25.384 INFO:teuthology.orchestra.run.smithi173.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 216 kB/s | 16 kB 00:00 2024-01-23T07:17:25.409 INFO:teuthology.orchestra.run.smithi173.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-01-23T07:17:25.426 INFO:teuthology.orchestra.run.smithi173.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2024-01-23T07:17:25.452 INFO:teuthology.orchestra.run.smithi173.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-01-23T07:17:25.494 INFO:teuthology.orchestra.run.smithi173.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-01-23T07:17:25.519 INFO:teuthology.orchestra.run.smithi173.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 216 kB/s | 20 kB 00:00 2024-01-23T07:17:25.524 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:17:25.525 INFO:teuthology.orchestra.run.smithi173.stdout:Total 7.4 MB/s | 30 MB 00:04 2024-01-23T07:17:25.661 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:17:25.700 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:17:25.700 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:17:26.126 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:17:26.127 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:17:27.483 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:17:27.548 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-01-23T07:17:27.580 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-01-23T07:17:27.608 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-01-23T07:17:27.678 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-01-23T07:17:27.732 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-01-23T07:17:27.765 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-01-23T07:17:27.856 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-01-23T07:17:27.935 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-01-23T07:17:27.985 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-01-23T07:17:28.019 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-01-23T07:17:28.049 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-01-23T07:17:28.084 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-01-23T07:17:28.118 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-01-23T07:17:28.158 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-01-23T07:17:28.193 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-01-23T07:17:28.227 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-01-23T07:17:28.265 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-01-23T07:17:28.336 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-01-23T07:17:28.480 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-01-23T07:17:28.572 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-01-23T07:17:28.627 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-01-23T07:17:28.665 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/36 2024-01-23T07:17:28.715 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-01-23T07:17:28.770 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-01-23T07:17:28.955 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-01-23T07:17:29.002 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-01-23T07:17:29.073 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-01-23T07:17:29.161 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-01-23T07:17:29.202 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-01-23T07:17:29.316 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-01-23T07:17:29.484 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-779.g1d156303.el9.n 31/36 2024-01-23T07:17:29.512 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 32/36 2024-01-23T07:17:29.537 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 32/36 2024-01-23T07:17:29.537 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:17:29.537 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-23T07:17:29.537 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-23T07:17:29.537 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-23T07:17:29.537 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:31.014 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 33/36 2024-01-23T07:17:31.041 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 33/36 2024-01-23T07:17:31.042 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:17:31.042 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-23T07:17:31.042 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-23T07:17:31.042 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-23T07:17:31.042 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:31.489 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 34/36 2024-01-23T07:17:31.513 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 34/36 2024-01-23T07:17:31.513 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:17:31.513 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-23T07:17:31.513 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-23T07:17:31.513 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-23T07:17:31.513 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:31.723 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 35/36 2024-01-23T07:17:31.746 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 35/36 2024-01-23T07:17:31.746 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:17:31.746 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-23T07:17:31.747 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-23T07:17:31.747 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-23T07:17:31.747 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:31.812 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:19.0.0-779.g1d156303.el9.x86_64 36/36 2024-01-23T07:17:33.638 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-2:19.0.0-779.g1d156303.el9.x86_64 36/36 2024-01-23T07:17:33.638 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:19.0.0-779.g1d156303.el9.x86_64 1/36 2024-01-23T07:17:33.638 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 2/36 2024-01-23T07:17:33.638 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 3/36 2024-01-23T07:17:33.638 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 4/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 5/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-779.g1d156303.el9.n 6/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 11/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-01-23T07:17:33.639 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-01-23T07:17:33.640 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-01-23T07:17:33.641 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-01-23T07:17:33.641 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-01-23T07:17:33.641 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-01-23T07:17:34.765 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: lua-5.4.4-4.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-23T07:17:34.766 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-23T07:17:34.767 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-23T07:17:34.768 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-23T07:17:34.769 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-23T07:17:34.769 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:34.769 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:35.105 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base 2024-01-23T07:17:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:54 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.993 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:35.994 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:35.995 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:35.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:35.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:36.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:36.002 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:17:36.058 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:36.059 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:17:36.059 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:36.132 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install cephadm 2024-01-23T07:17:36.720 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:55 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.009 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:37.010 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.011 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:37.012 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:37.013 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.014 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.015 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.016 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:37.017 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.018 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.019 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:37.075 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:37.075 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:37.075 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 742 k 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 742 k 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 748 k 2024-01-23T07:17:37.076 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:17:37.972 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm-19.0.0-779.g1d156303.el9.noarch.rpm 828 kB/s | 742 kB 00:00 2024-01-23T07:17:37.972 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:17:37.973 INFO:teuthology.orchestra.run.smithi173.stdout:Total 826 kB/s | 742 kB 00:00 2024-01-23T07:17:37.973 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:17:37.979 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:17:37.979 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:17:37.985 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:17:37.985 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:17:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:17:38.524 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:17:38.610 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:17:38.991 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:17:39.320 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:17:39.320 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:39.320 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:17:39.320 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:17:39.320 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:39.320 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:39.547 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache 2024-01-23T07:17:40.153 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:59 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:40.448 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:40.448 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:40.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:40.448 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.448 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:40.449 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:40.450 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.451 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:40.452 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.453 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:40.454 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.455 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.456 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.457 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:40.513 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-779.g1d156303.el9 ceph 145 k 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:17:40.514 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:40.515 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 145 k 2024-01-23T07:17:40.515 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 436 k 2024-01-23T07:17:40.515 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:17:40.994 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-19.0.0-779.g1d15630 303 kB/s | 145 kB 00:00 2024-01-23T07:17:40.995 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:17:40.995 INFO:teuthology.orchestra.run.smithi173.stdout:Total 302 kB/s | 145 kB 00:00 2024-01-23T07:17:40.995 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:17:41.003 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:17:41.003 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:17:41.060 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:17:41.060 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:17:41.224 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:17:41.287 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-779.g1d156303.e 1/1 2024-01-23T07:17:41.311 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-779.g1d156303.e 1/1 2024-01-23T07:17:41.311 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:17:41.311 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-23T07:17:41.312 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:42.363 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-779.g1d156303.e 1/1 2024-01-23T07:17:42.363 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:42.363 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:17:42.363 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:17:42.363 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:42.363 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:42.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr 2024-01-23T07:17:43.204 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:02 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:43.497 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:43.497 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:43.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:43.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:43.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:43.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:43.505 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.506 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.506 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.506 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:43.506 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:17:43.561 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:43.562 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:17:43.562 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:43.635 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-dashboard 2024-01-23T07:17:44.223 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:03 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:44.514 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:44.515 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.516 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.517 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.518 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.519 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.520 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.521 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.522 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:44.579 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:44.580 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:44.580 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:17:44.580 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:44.580 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:17:44.580 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 1.7 M 2024-01-23T07:17:44.580 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 28 k 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 15 k 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout:Install 5 Packages 2024-01-23T07:17:44.581 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:44.582 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.0 M 2024-01-23T07:17:44.582 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 8.5 M 2024-01-23T07:17:44.582 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:17:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:(1/5): ceph-grafana-dashboards-19.0.0-779.g1d15 65 kB/s | 28 kB 00:00 2024-01-23T07:17:45.114 INFO:teuthology.orchestra.run.smithi173.stdout:(2/5): ceph-prometheus-alerts-19.0.0-779.g1d156 33 kB/s | 15 kB 00:00 2024-01-23T07:17:45.881 INFO:teuthology.orchestra.run.smithi173.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 39 kB/s | 31 kB 00:00 2024-01-23T07:17:45.906 INFO:teuthology.orchestra.run.smithi173.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 238 kB/s | 188 kB 00:00 2024-01-23T07:17:46.065 INFO:teuthology.orchestra.run.smithi173.stdout:(5/5): ceph-mgr-dashboard-19.0.0-779.g1d156303. 1.2 MB/s | 1.7 MB 00:01 2024-01-23T07:17:46.068 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:17:46.068 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2024-01-23T07:17:46.069 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:17:46.075 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:17:46.075 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:17:46.136 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:17:46.136 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:17:46.385 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:17:46.463 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-01-23T07:17:46.503 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-01-23T07:17:46.533 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-779.g1d156303.el9.no 3/5 2024-01-23T07:17:46.767 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-779.g1d156303.el9.n 4/5 2024-01-23T07:17:46.801 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 5/5 2024-01-23T07:17:47.406 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 5/5 2024-01-23T07:17:47.406 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-779.g1d156303.el9.n 1/5 2024-01-23T07:17:47.406 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 2/5 2024-01-23T07:17:47.406 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-779.g1d156303.el9.no 3/5 2024-01-23T07:17:47.406 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-01-23T07:17:47.727 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-01-23T07:17:47.727 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:47.727 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:17:47.727 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:17:47.727 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:17:47.728 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:17:47.728 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-23T07:17:47.728 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-23T07:17:47.728 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:47.728 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:17:47.964 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-diskprediction-local 2024-01-23T07:17:48.556 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:07 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:17:48.848 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:17:48.848 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:17:48.849 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:17:48.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.849 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:17:48.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.849 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:17:48.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.850 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:17:48.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.850 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:17:48.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.850 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:17:48.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.851 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:17:48.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.851 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:17:48.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.851 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:17:48.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.852 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:17:48.852 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.852 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:17:48.852 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.852 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:17:48.853 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.853 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:17:48.853 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.853 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:17:48.853 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.853 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:17:48.854 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.854 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:17:48.854 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.854 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:17:48.854 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.854 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:17:48.855 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.855 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:17:48.855 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.855 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:17:48.855 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.855 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:17:48.855 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:17:48.856 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.857 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.858 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:17:48.859 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.859 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:17:48.859 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.859 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:17:48.859 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.859 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:17:48.859 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.860 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.861 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.862 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.863 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:17:48.916 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:17:48.917 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-01-23T07:17:48.917 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:17:48.917 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 7.4 M 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-01-23T07:17:48.918 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-01-23T07:17:48.919 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:48.919 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:17:48.919 INFO:teuthology.orchestra.run.smithi173.stdout:====================================================================================== 2024-01-23T07:17:48.919 INFO:teuthology.orchestra.run.smithi173.stdout:Install 12 Packages 2024-01-23T07:17:48.919 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:17:48.919 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 38 M 2024-01-23T07:17:48.919 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 209 M 2024-01-23T07:17:48.920 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:17:49.288 INFO:teuthology.orchestra.run.smithi173.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-01-23T07:17:49.330 INFO:teuthology.orchestra.run.smithi173.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 803 kB 00:00 2024-01-23T07:17:49.663 INFO:teuthology.orchestra.run.smithi173.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 87 kB/s | 33 kB 00:00 2024-01-23T07:17:49.805 INFO:teuthology.orchestra.run.smithi173.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 128 kB/s | 18 kB 00:00 2024-01-23T07:17:49.947 INFO:teuthology.orchestra.run.smithi173.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 249 kB/s | 35 kB 00:00 2024-01-23T07:17:50.622 INFO:teuthology.orchestra.run.smithi173.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.3 MB/s | 3.0 MB 00:01 2024-01-23T07:17:50.764 INFO:teuthology.orchestra.run.smithi173.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-01-23T07:17:51.031 INFO:teuthology.orchestra.run.smithi173.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 4.4 MB/s | 4.7 MB 00:01 2024-01-23T07:17:51.148 INFO:teuthology.orchestra.run.smithi173.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-01-23T07:17:51.382 INFO:teuthology.orchestra.run.smithi173.stdout:(10/12): ceph-mgr-diskprediction-local-19.0.0-7 3.3 MB/s | 7.4 MB 00:02 2024-01-23T07:17:57.315 INFO:teuthology.orchestra.run.smithi173.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 797 kB/s | 5.1 MB 00:06 2024-01-23T07:18:08.222 INFO:teuthology.orchestra.run.smithi173.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 975 kB/s | 16 MB 00:17 2024-01-23T07:18:08.223 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:08.223 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.0 MB/s | 38 MB 00:19 2024-01-23T07:18:08.579 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:08.605 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:08.605 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:09.046 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:09.046 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:09.806 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:09.866 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-01-23T07:18:09.902 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-01-23T07:18:10.003 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-01-23T07:18:10.037 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-01-23T07:18:10.214 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-01-23T07:18:10.245 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-01-23T07:18:10.336 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-01-23T07:18:10.988 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-01-23T07:18:11.098 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-01-23T07:18:12.332 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-01-23T07:18:13.361 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-01-23T07:18:13.386 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-779.g1d1563 12/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-779.g1d1563 12/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-779.g1d1563 1/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-01-23T07:18:15.815 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-01-23T07:18:15.816 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-01-23T07:18:15.816 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-01-23T07:18:15.816 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-01-23T07:18:15.816 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-23T07:18:16.278 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-23T07:18:16.279 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-23T07:18:16.279 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-23T07:18:16.279 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-23T07:18:16.279 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-23T07:18:16.279 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-23T07:18:16.279 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:16.279 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:16.678 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-rook 2024-01-23T07:18:17.287 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:36 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:17.574 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:17.574 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:17.574 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:17.575 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.576 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:17.577 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:17.578 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:17.579 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.580 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.581 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.582 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.583 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 51 k 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-01-23T07:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:Install 13 Packages 2024-01-23T07:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.2 M 2024-01-23T07:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 26 M 2024-01-23T07:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:17.861 INFO:teuthology.orchestra.run.smithi173.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 236 kB/s | 19 kB 00:00 2024-01-23T07:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 241 kB/s | 26 kB 00:00 2024-01-23T07:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-01-23T07:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-01-23T07:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 279 kB 00:00 2024-01-23T07:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 813 kB/s | 54 kB 00:00 2024-01-23T07:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 225 kB/s | 15 kB 00:00 2024-01-23T07:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 296 kB/s | 32 kB 00:00 2024-01-23T07:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:(9/13): python3-google-auth-2.26.2-1.el9.noarch 2.0 MB/s | 202 kB 00:00 2024-01-23T07:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-01-23T07:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-01-23T07:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:(12/13): ceph-mgr-rook-19.0.0-779.g1d156303.el9 83 kB/s | 51 kB 00:00 2024-01-23T07:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.3 MB/s | 1.0 MB 00:00 2024-01-23T07:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-01-23T07:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:18.660 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:18.661 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:19.179 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:19.353 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-01-23T07:18:19.407 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-01-23T07:18:19.462 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-01-23T07:18:19.508 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-01-23T07:18:19.575 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-01-23T07:18:19.669 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-01-23T07:18:19.778 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 7/13 2024-01-23T07:18:19.835 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-01-23T07:18:20.555 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-01-23T07:18:20.606 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-01-23T07:18:20.640 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-01-23T07:18:20.688 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-01-23T07:18:20.710 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 13/13 2024-01-23T07:18:21.502 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 13/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 1/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 10/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-01-23T07:18:21.503 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-23T07:18:21.896 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:21.897 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:22.179 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-cephadm 2024-01-23T07:18:22.780 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:41 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:23.071 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.072 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:23.073 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:23.074 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.075 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:23.076 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.077 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.078 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.079 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.080 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.080 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:23.080 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.080 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.080 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.080 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:23.138 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:23.138 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:23.138 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:18:23.138 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 133 k 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:23.139 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:23.140 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2024-01-23T07:18:23.140 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:23.140 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 7.0 M 2024-01-23T07:18:23.140 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 33 M 2024-01-23T07:18:23.140 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:23.915 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 428 kB/s | 249 kB 00:00 2024-01-23T07:18:24.174 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 2.1 MB/s | 548 kB 00:00 2024-01-23T07:18:24.216 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-01-23T07:18:24.258 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 1.2 MB/s | 51 kB 00:00 2024-01-23T07:18:25.934 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-01-23T07:18:29.866 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): ceph-mgr-cephadm-19.0.0-779.g1d156303.el 20 kB/s | 133 kB 00:06 2024-01-23T07:18:29.868 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:29.868 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.0 MB/s | 7.0 MB 00:06 2024-01-23T07:18:29.941 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:29.953 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:29.953 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:30.059 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:30.059 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:30.369 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:30.528 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-01-23T07:18:30.584 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-01-23T07:18:31.094 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-01-23T07:18:31.178 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-01-23T07:18:31.238 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-01-23T07:18:31.263 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 6/6 2024-01-23T07:18:32.141 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 6/6 2024-01-23T07:18:32.141 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/6 2024-01-23T07:18:32.141 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-01-23T07:18:32.141 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-01-23T07:18:32.141 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-01-23T07:18:32.141 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-23T07:18:32.470 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:32.471 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:32.719 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse 2024-01-23T07:18:33.326 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:52 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:33.619 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:33.620 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:33.621 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.622 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.623 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.624 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:33.625 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.626 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.627 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.628 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:33.687 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:33.687 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:33.687 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:18:33.687 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:33.687 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:33.687 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:19.0.0-779.g1d156303.el9 ceph 886 k 2024-01-23T07:18:33.688 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:18:33.688 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-01-23T07:18:33.688 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:33.688 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:33.688 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:33.688 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-01-23T07:18:33.688 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:33.689 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 966 k 2024-01-23T07:18:33.689 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.8 M 2024-01-23T07:18:33.689 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:34.309 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 227 kB/s | 80 kB 00:00 2024-01-23T07:18:35.209 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-fuse-19.0.0-779.g1d156303.el9.x86_6 707 kB/s | 886 kB 00:01 2024-01-23T07:18:35.210 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:35.210 INFO:teuthology.orchestra.run.smithi173.stdout:Total 635 kB/s | 966 kB 00:01 2024-01-23T07:18:35.224 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:35.248 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:35.248 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:35.332 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:35.332 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:35.516 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:35.635 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-01-23T07:18:35.701 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 2/2 2024-01-23T07:18:36.469 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 2/2 2024-01-23T07:18:36.469 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/2 2024-01-23T07:18:36.806 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-01-23T07:18:36.806 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:36.806 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:36.806 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-01-23T07:18:36.806 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:36.806 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:37.113 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-volume 2024-01-23T07:18:37.731 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:56 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:38.023 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:38.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:38.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.029 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.030 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.031 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.032 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.033 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:38.090 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:38.091 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-01-23T07:18:38.091 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:38.091 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 262 k 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 262 k 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.2 M 2024-01-23T07:18:38.092 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:38.330 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-volume-19.0.0-779.g1d156303.el9.noarch.rpm 1.1 MB/s | 262 kB 00:00 2024-01-23T07:18:38.331 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:38.331 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.1 MB/s | 262 kB 00:00 2024-01-23T07:18:38.331 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:38.339 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:38.339 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:38.373 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:38.374 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:38.589 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:38.666 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:18:38.682 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:18:38.682 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:18:38.682 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-23T07:18:38.682 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:39.813 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:18:39.814 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:39.814 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:39.814 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:18:39.814 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:39.814 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:40.114 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel 2024-01-23T07:18:40.729 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:59 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:41.019 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:41.019 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.020 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.021 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.022 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.023 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.024 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:41.025 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.026 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:41.027 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.028 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:41.085 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:41.086 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:41.086 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:18:41.086 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:19.0.0-779.g1d156303.el9 ceph 127 k 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 127 k 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 456 k 2024-01-23T07:18:41.087 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:41.402 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-19.0.0-779.g1d156303.el9.x86_64. 404 kB/s | 127 kB 00:00 2024-01-23T07:18:41.402 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:41.402 INFO:teuthology.orchestra.run.smithi173.stdout:Total 401 kB/s | 127 kB 00:00 2024-01-23T07:18:41.402 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:41.408 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:41.408 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:41.466 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:41.467 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:41.617 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:41.724 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:42.204 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:42.554 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:42.554 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:42.554 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:42.554 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:18:42.554 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:42.554 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:42.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2 2024-01-23T07:18:43.437 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:02 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:43.746 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:43.747 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:43.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:43.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:43.755 INFO:teuthology.orchestra.run.smithi173.stdout:Package libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:18:43.817 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:43.818 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:18:43.818 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:43.900 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs-devel 2024-01-23T07:18:44.523 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:03 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:44.817 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:44.817 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:44.819 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.820 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.821 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:44.822 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.823 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.824 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.825 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.826 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:44.883 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:19.0.0-779.g1d156303.el9 ceph 31 k 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:44.884 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 31 k 2024-01-23T07:18:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 140 k 2024-01-23T07:18:44.885 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:45.063 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs-devel-19.0.0-779.g1d156303.el9.x86_64 175 kB/s | 31 kB 00:00 2024-01-23T07:18:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:Total 173 kB/s | 31 kB 00:00 2024-01-23T07:18:45.064 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:45.067 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:45.100 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:45.190 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:45.293 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:45.679 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:45.978 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:45.978 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:45.978 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:45.978 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:18:45.978 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:45.978 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:46.150 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2 2024-01-23T07:18:46.755 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:05 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:47.048 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:47.048 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:47.048 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:47.048 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.048 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:47.048 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.048 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:47.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:47.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:47.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:47.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:47.058 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:18:47.116 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:47.116 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:18:47.116 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:47.192 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1 2024-01-23T07:18:47.797 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:06 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:48.087 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:48.087 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:48.087 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.088 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:48.089 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:48.090 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:48.091 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:48.092 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.093 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.094 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.095 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.096 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:48.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.096 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.097 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.097 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:48.097 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.097 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.097 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.097 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:48.098 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:18:48.154 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:48.156 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:18:48.156 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:48.235 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados 2024-01-23T07:18:48.839 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:07 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:49.131 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:49.132 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.133 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:49.134 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:49.135 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.136 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.137 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.138 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.139 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.140 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.140 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:49.140 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.140 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.140 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.140 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:49.140 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:18:49.200 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:49.200 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:18:49.201 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:49.277 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw 2024-01-23T07:18:49.881 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:08 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:50.174 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:50.174 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.175 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.176 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.177 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.178 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.179 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:50.180 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.184 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.185 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.186 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.187 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:50.187 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:18:50.242 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:50.243 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:18:50.244 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:50.336 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs 2024-01-23T07:18:50.937 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:09 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:51.230 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:51.230 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:51.231 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:51.232 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.233 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:51.234 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.235 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.236 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.237 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.238 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:51.239 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.240 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:51.240 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:18:51.297 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:51.298 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:18:51.298 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:51.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd 2024-01-23T07:18:51.983 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:10 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.277 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:52.278 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.279 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:52.280 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:52.281 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.282 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.283 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.284 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.285 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.286 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:52.286 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:18:52.346 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:52.347 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:18:52.347 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:52.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse 2024-01-23T07:18:53.034 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:12 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:53.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:53.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:53.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:53.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.333 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.334 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.335 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:53.336 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.337 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:53.396 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:53.397 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:53.397 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-01-23T07:18:53.397 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:53.397 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:53.397 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:19.0.0-779.g1d156303.el9 ceph 85 k 2024-01-23T07:18:53.397 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:53.398 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:53.398 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:53.398 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:18:53.398 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:53.398 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 85 k 2024-01-23T07:18:53.398 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 231 k 2024-01-23T07:18:53.398 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:53.608 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-19.0.0-779.g1d156303.el9.x86_64.rpm 405 kB/s | 85 kB 00:00 2024-01-23T07:18:53.609 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:53.609 INFO:teuthology.orchestra.run.smithi173.stdout:Total 402 kB/s | 85 kB 00:00 2024-01-23T07:18:53.609 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:53.616 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:53.616 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:53.674 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:53.674 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:53.831 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:53.924 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:54.321 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:54.676 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:54.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:54.677 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:18:54.677 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:18:54.677 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:54.677 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:18:54.936 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror 2024-01-23T07:18:55.547 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:14 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:18:55.842 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:18:55.842 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:18:55.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:18:55.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:18:55.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:18:55.844 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:18:55.845 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:18:55.846 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.847 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.848 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.849 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.850 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.851 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:18:55.909 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:18:55.910 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:55.910 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:18:55.910 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:55.910 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:18:55.910 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:19.0.0-779.g1d156303.el9 ceph 3.1 M 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 3.1 M 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 13 M 2024-01-23T07:18:55.911 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:18:58.494 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-19.0.0-779.g1d156303.el9.x86_64.rpm 1.2 MB/s | 3.1 MB 00:02 2024-01-23T07:18:58.495 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:18:58.495 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.2 MB/s | 3.1 MB 00:02 2024-01-23T07:18:58.495 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:18:58.506 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:18:58.506 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:18:58.586 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:18:58.586 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:18:59.010 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:18:59.070 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:59.095 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:18:59.095 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:18:59.095 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-23T07:18:59.095 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T07:18:59.095 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T07:18:59.095 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:00.327 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:19:00.327 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:00.327 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:19:00.327 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:00.327 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:00.328 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:19:00.586 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd 2024-01-23T07:19:01.202 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:20 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:19:01.493 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.494 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:19:01.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:19:01.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:19:01.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:19:01.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:19:01.560 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:19.0.0-779.g1d156303.el9 ceph 170 k 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:19:01.561 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:01.562 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:19:01.562 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:01.562 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 170 k 2024-01-23T07:19:01.562 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 490 k 2024-01-23T07:19:01.562 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:19:01.948 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-19.0.0-779.g1d156303.el9.x86_64.rpm 441 kB/s | 170 kB 00:00 2024-01-23T07:19:01.948 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:19:01.948 INFO:teuthology.orchestra.run.smithi173.stdout:Total 440 kB/s | 170 kB 00:00 2024-01-23T07:19:01.948 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:19:01.956 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:19:01.956 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:19:02.015 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:19:02.015 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:19:02.162 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:19:02.263 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:19:02.720 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:19:03.075 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:19:03.076 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:03.076 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:19:03.076 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:03.076 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:03.076 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:19:03.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base-debuginfo 2024-01-23T07:19:03.916 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:22 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:19:04.207 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:19:04.208 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.209 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.210 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.211 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.212 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.213 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:19:04.214 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.215 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.216 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.217 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:19:04.277 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 67 M 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 22 M 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2024-01-23T07:19:04.278 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:04.279 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 89 M 2024-01-23T07:19:04.279 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 490 M 2024-01-23T07:19:04.279 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:19:05.569 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): ceph-debuginfo-19.0.0-779.g1d156303.el9. 17 MB/s | 22 MB 00:01 2024-01-23T07:19:07.078 INFO:teuthology.orchestra.run.smithi116.stdout:[MIRROR] gperftools-libs-2.9.1-2.el9.x86_64.rpm: Curl error (28): Timeout was reached for https://epel.mirror.shastacoe.net/epel/9/Everything/x86_64/Packages/g/gperftools-libs-2.9.1-2.el9.x86_64.rpm [Failed to connect to epel.mirror.shastacoe.net port 443: Connection timed out] 2024-01-23T07:19:07.672 INFO:teuthology.orchestra.run.smithi116.stdout:(29/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 802 B/s | 309 kB 06:33 2024-01-23T07:19:07.672 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:19:07.672 INFO:teuthology.orchestra.run.smithi116.stdout:Total 143 kB/s | 55 MB 06:36 2024-01-23T07:19:07.739 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:19:07.776 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:19:07.776 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:19:08.249 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:19:08.249 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:19:09.634 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:19:09.717 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-01-23T07:19:09.752 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2024-01-23T07:19:09.813 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2024-01-23T07:19:10.191 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2024-01-23T07:19:10.219 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:19.0.0-779.g1d156303.el9.x86_64 5/31 2024-01-23T07:19:10.311 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:19.0.0-779.g1d156303.el9.x86_64 5/31 2024-01-23T07:19:10.397 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 6/31 2024-01-23T07:19:10.438 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 7/31 2024-01-23T07:19:10.500 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 7/31 2024-01-23T07:19:10.537 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2024-01-23T07:19:10.580 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:19.0.0-779.g1d156303.el9.x 9/31 2024-01-23T07:19:10.649 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 10/31 2024-01-23T07:19:10.673 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 11/31 2024-01-23T07:19:10.723 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 11/31 2024-01-23T07:19:10.829 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-01-23T07:19:10.864 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-01-23T07:19:10.905 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-01-23T07:19:10.937 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-01-23T07:19:10.966 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-01-23T07:19:10.999 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-01-23T07:19:11.306 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-01-23T07:19:11.328 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:19.0.0-779.g1d156303.el9.x86_64 19/31 2024-01-23T07:19:11.419 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:19.0.0-779.g1d156303.el9.x86_64 19/31 2024-01-23T07:19:11.450 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 20/31 2024-01-23T07:19:11.495 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-01-23T07:19:11.930 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-01-23T07:19:11.956 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:19.0.0-779.g1d156303.el9.x86_64 23/31 2024-01-23T07:19:12.030 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:19.0.0-779.g1d156303.el9.x86_64 23/31 2024-01-23T07:19:12.103 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 24/31 2024-01-23T07:19:12.133 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:19.0.0-779.g1d156303.el9.x86 25/31 2024-01-23T07:19:13.851 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-base-debuginfo-19.0.0-779.g1d156303 7.0 MB/s | 67 MB 00:09 2024-01-23T07:19:13.853 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:19:13.854 INFO:teuthology.orchestra.run.smithi173.stdout:Total 9.3 MB/s | 89 MB 00:09 2024-01-23T07:19:13.854 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:19:13.859 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:19:13.859 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:19:14.226 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 26/31 2024-01-23T07:19:14.271 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 26/31 2024-01-23T07:19:14.436 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:19:14.437 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:19:14.804 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 26/31 2024-01-23T07:19:14.841 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 27/31 2024-01-23T07:19:14.924 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 27/31 2024-01-23T07:19:14.924 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-23T07:19:14.925 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-23T07:19:14.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:14.960 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 28/31 2024-01-23T07:19:17.537 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 28/31 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /root 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2024-01-23T07:19:24.057 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:24.490 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/2 2024-01-23T07:19:24.568 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 2/2 2024-01-23T07:19:24.900 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 29/31 2024-01-23T07:19:24.924 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 29/31 2024-01-23T07:19:24.924 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:19:24.924 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-23T07:19:24.924 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-23T07:19:24.925 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-23T07:19:24.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:24.926 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-23T07:19:25.012 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-01-23T07:19:25.012 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-23T07:19:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-01-23T07:19:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 1/31 2024-01-23T07:19:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 2/31 2024-01-23T07:19:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 3/31 2024-01-23T07:19:26.126 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 4/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 5/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 6/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:19.0.0-779.g1d156303.el9.x86_64 7/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:19.0.0-779.g1d156303.el9.x 8/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:19.0.0-779.g1d156303.el9.x86 9/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 10/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 11/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 12/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 13/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-01-23T07:19:26.127 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-01-23T07:19:26.128 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-01-23T07:19:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-01-23T07:19:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:19.0.0-779.g1d156303.el9.x86_64 28/31 2024-01-23T07:19:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-01-23T07:19:26.129 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:19.0.0-779.g1d156303.el9.x86_64 30/31 2024-01-23T07:19:27.297 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-01-23T07:19:27.297 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:27.297 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2024-01-23T07:19:27.297 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-23T07:19:27.298 INFO:teuthology.orchestra.run.smithi116.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.299 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-23T07:19:27.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.300 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:27.300 INFO:teuthology.orchestra.run.smithi116.stdout: re2-1:20211101-3.el9.x86_64 2024-01-23T07:19:27.300 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-23T07:19:27.300 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:27.301 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:19:27.631 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-test 2024-01-23T07:19:27.948 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 2/2 2024-01-23T07:19:27.949 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/2 2024-01-23T07:19:28.227 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:00 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:19:28.270 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2/2 2024-01-23T07:19:28.270 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:28.270 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:19:28.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:28.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:28.270 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:28.270 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:19:28.514 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-common-debuginfo 2024-01-23T07:19:28.521 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:19:28.521 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:19:28.521 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:19:28.521 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.521 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:19:28.521 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.522 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:19:28.522 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.522 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:19:28.522 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.522 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:19:28.522 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.522 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.523 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:19:28.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:19:28.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:19:28.524 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.524 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:19:28.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:19:28.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.525 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:19:28.525 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:19:28.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:19:28.526 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.526 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:19:28.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:19:28.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:19:28.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.527 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:19:28.527 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:19:28.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:19:28.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:19:28.528 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.528 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:19:28.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.529 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:19:28.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.529 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:19:28.529 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.530 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:19:28.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.530 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:19:28.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.530 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:19:28.530 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.530 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:19:28.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.531 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:19:28.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.531 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:19:28.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.531 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:19:28.531 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.532 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:19:28.532 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.532 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:19:28.532 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.532 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:19:28.532 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.533 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.533 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.533 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:19:28.533 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.533 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.533 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.533 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.534 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:19:28.535 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.535 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.535 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.535 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.535 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:19:28.535 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.535 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.536 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.536 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.536 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:19:28.536 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.536 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.536 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.536 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.537 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:19:28.537 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.537 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.537 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.537 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.537 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:19:28.537 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.538 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.538 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.538 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.538 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:19:28.538 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.539 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.539 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.539 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:19:28.588 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:19:28.589 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:19:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:19:28.589 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:19:28.589 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:19:28.589 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:19.0.0-779.g1d156303.el9 ceph 46 M 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:19.0.0-779.g1d156303.el9 ceph 163 k 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout:Install 6 Packages 2024-01-23T07:19:28.590 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:28.591 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 47 M 2024-01-23T07:19:28.591 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 201 M 2024-01-23T07:19:28.591 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:19:29.122 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:48 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:19:29.207 INFO:teuthology.orchestra.run.smithi116.stdout:(1/6): libcephsqlite-19.0.0-779.g1d156303.el9.x 376 kB/s | 163 kB 00:00 2024-01-23T07:19:29.282 INFO:teuthology.orchestra.run.smithi116.stdout:(2/6): jq-1.6-16.el9.x86_64.rpm 367 kB/s | 187 kB 00:00 2024-01-23T07:19:29.435 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:19:29.435 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:19:29.435 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:19:29.435 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.435 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:19:29.435 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.435 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:19:29.436 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.437 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.438 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.439 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:19:29.440 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.441 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.442 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.443 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.444 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:19:29.466 INFO:teuthology.orchestra.run.smithi116.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.6 MB/s | 305 kB 00:00 2024-01-23T07:19:29.507 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 411 M 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:19:29.508 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 411 M 2024-01-23T07:19:29.509 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.7 G 2024-01-23T07:19:29.509 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:19:29.574 INFO:teuthology.orchestra.run.smithi116.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 589 kB/s | 64 kB 00:00 2024-01-23T07:19:29.800 INFO:teuthology.orchestra.run.smithi116.stdout:(5/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 368 kB/s | 218 kB 00:00 2024-01-23T07:19:44.808 INFO:teuthology.orchestra.run.smithi116.stdout:(6/6): ceph-test-19.0.0-779.g1d156303.el9.x86_6 2.9 MB/s | 46 MB 00:16 2024-01-23T07:19:44.809 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:19:44.810 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.9 MB/s | 47 MB 00:16 2024-01-23T07:19:44.858 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:19:44.877 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:19:44.877 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:19:45.252 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:19:45.252 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:19:45.811 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:19:45.878 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-01-23T07:19:45.919 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-01-23T07:19:45.951 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-01-23T07:19:45.991 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-01-23T07:19:46.018 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 5/6 2024-01-23T07:19:50.376 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 5/6 2024-01-23T07:19:50.451 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 6/6 2024-01-23T07:19:52.786 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 6/6 2024-01-23T07:19:52.786 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 1/6 2024-01-23T07:19:52.786 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 2/6 2024-01-23T07:19:52.786 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-01-23T07:19:52.786 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-01-23T07:19:52.786 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-01-23T07:19:53.242 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-01-23T07:19:53.242 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.6-16.el9.x86_64 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:53.243 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:19:53.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph 2024-01-23T07:19:54.175 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:26 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:19:54.465 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:19:54.465 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.466 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.467 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.468 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:19:54.469 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:19:54.470 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.471 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.472 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.473 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.474 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:19:54.541 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:19:54.543 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:19:54.543 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:19:54.543 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:19:54.543 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:19.0.0-779.g1d156303.el9 ceph 6.5 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:19.0.0-779.g1d156303.el9 ceph 2.1 M 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.5 M 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 245 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:19.0.0-779.g1d156303.el9 ceph 4.7 M 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:19.0.0-779.g1d156303.el9 ceph 17 M 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-23T07:19:54.544 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-01-23T07:19:54.545 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests noarch 2.25.1-7.el9 baseos 124 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:19:54.546 INFO:teuthology.orchestra.run.smithi116.stdout:Install 36 Packages 2024-01-23T07:19:54.547 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:19:54.547 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 30 M 2024-01-23T07:19:54.547 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 106 M 2024-01-23T07:19:54.547 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:19:55.190 INFO:teuthology.orchestra.run.smithi116.stdout:(1/36): ceph-19.0.0-779.g1d156303.el9.x86_64.rp 24 kB/s | 6.5 kB 00:00 2024-01-23T07:19:56.132 INFO:teuthology.orchestra.run.smithi116.stdout:(2/36): ceph-mds-19.0.0-779.g1d156303.el9.x86_6 1.7 MB/s | 2.1 MB 00:01 2024-01-23T07:19:56.299 INFO:teuthology.orchestra.run.smithi116.stdout:(3/36): ceph-mgr-19.0.0-779.g1d156303.el9.x86_6 1.1 MB/s | 1.5 MB 00:01 2024-01-23T07:19:56.457 INFO:teuthology.orchestra.run.smithi116.stdout:(4/36): ceph-mgr-modules-core-19.0.0-779.g1d156 1.5 MB/s | 245 kB 00:00 2024-01-23T07:19:56.959 INFO:teuthology.orchestra.run.smithi116.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 506 kB/s | 253 kB 00:00 2024-01-23T07:19:57.233 INFO:teuthology.orchestra.run.smithi116.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 4.5 MB/s | 1.2 MB 00:00 2024-01-23T07:19:57.342 INFO:teuthology.orchestra.run.smithi116.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 982 kB/s | 106 kB 00:00 2024-01-23T07:19:57.450 INFO:teuthology.orchestra.run.smithi116.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.2 MB/s | 135 kB 00:00 2024-01-23T07:19:57.559 INFO:teuthology.orchestra.run.smithi116.stdout:(9/36): python3-requests-2.25.1-7.el9.noarch.rp 1.1 MB/s | 124 kB 00:00 2024-01-23T07:19:57.668 INFO:teuthology.orchestra.run.smithi116.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-01-23T07:19:57.735 INFO:teuthology.orchestra.run.smithi116.stdout:(11/36): ceph-mon-19.0.0-779.g1d156303.el9.x86_ 1.8 MB/s | 4.7 MB 00:02 2024-01-23T07:19:57.797 INFO:teuthology.orchestra.run.smithi116.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-01-23T07:19:57.902 INFO:teuthology.orchestra.run.smithi116.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 331 kB/s | 35 kB 00:00 2024-01-23T07:19:58.002 INFO:teuthology.orchestra.run.smithi116.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 510 kB/s | 51 kB 00:00 2024-01-23T07:19:58.103 INFO:teuthology.orchestra.run.smithi116.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2024-01-23T07:19:58.195 INFO:teuthology.orchestra.run.smithi116.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-01-23T07:19:58.228 INFO:teuthology.orchestra.run.smithi116.stdout:(17/36): python3-mako-1.1.4-6.el9.noarch.rpm 349 kB/s | 172 kB 00:00 2024-01-23T07:19:58.512 INFO:teuthology.orchestra.run.smithi116.stdout:(18/36): ceph-osd-19.0.0-779.g1d156303.el9.x86_ 7.0 MB/s | 17 MB 00:02 2024-01-23T07:19:58.529 INFO:teuthology.orchestra.run.smithi116.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 159 kB/s | 43 kB 00:00 2024-01-23T07:19:58.612 INFO:teuthology.orchestra.run.smithi116.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 362 kB/s | 151 kB 00:00 2024-01-23T07:19:58.913 INFO:teuthology.orchestra.run.smithi116.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 429 kB/s | 172 kB 00:00 2024-01-23T07:19:59.004 INFO:teuthology.orchestra.run.smithi116.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 27 kB/s | 11 kB 00:00 2024-01-23T07:19:59.205 INFO:teuthology.orchestra.run.smithi116.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 60 kB/s | 18 kB 00:00 2024-01-23T07:19:59.238 INFO:teuthology.orchestra.run.smithi116.stdout:(24/36): python3-cherrypy-18.6.1-2.el9.noarch.r 505 kB/s | 358 kB 00:00 2024-01-23T07:19:59.263 INFO:teuthology.orchestra.run.smithi116.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 89 kB/s | 23 kB 00:00 2024-01-23T07:19:59.289 INFO:teuthology.orchestra.run.smithi116.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 233 kB/s | 19 kB 00:00 2024-01-23T07:19:59.339 INFO:teuthology.orchestra.run.smithi116.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 262 kB/s | 20 kB 00:00 2024-01-23T07:19:59.564 INFO:teuthology.orchestra.run.smithi116.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 154 kB/s | 46 kB 00:00 2024-01-23T07:19:59.673 INFO:teuthology.orchestra.run.smithi116.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 205 kB/s | 79 kB 00:00 2024-01-23T07:20:00.190 INFO:teuthology.orchestra.run.smithi116.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 320 kB/s | 272 kB 00:00 2024-01-23T07:20:00.207 INFO:teuthology.orchestra.run.smithi116.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 26 kB/s | 16 kB 00:00 2024-01-23T07:20:00.257 INFO:teuthology.orchestra.run.smithi116.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 154 kB/s | 90 kB 00:00 2024-01-23T07:20:00.407 INFO:teuthology.orchestra.run.smithi116.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 165 kB/s | 36 kB 00:00 2024-01-23T07:20:00.751 INFO:teuthology.orchestra.run.smithi116.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 423 kB/s | 230 kB 00:00 2024-01-23T07:20:01.234 INFO:teuthology.orchestra.run.smithi116.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 437 kB/s | 427 kB 00:00 2024-01-23T07:20:01.268 INFO:teuthology.orchestra.run.smithi116.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 23 kB/s | 20 kB 00:00 2024-01-23T07:20:01.272 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:01.272 INFO:teuthology.orchestra.run.smithi116.stdout:Total 4.4 MB/s | 30 MB 00:06 2024-01-23T07:20:01.412 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:01.451 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:01.451 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:01.877 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:01.877 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:03.235 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:03.296 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-01-23T07:20:03.328 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-01-23T07:20:03.356 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-01-23T07:20:03.427 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-01-23T07:20:03.488 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-01-23T07:20:03.521 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-01-23T07:20:03.613 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-01-23T07:20:03.683 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-01-23T07:20:03.724 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-01-23T07:20:03.759 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-01-23T07:20:03.797 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-01-23T07:20:03.840 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-01-23T07:20:03.875 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-01-23T07:20:03.914 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-01-23T07:20:03.949 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-01-23T07:20:03.983 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-01-23T07:20:04.021 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-01-23T07:20:04.094 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-01-23T07:20:04.231 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-01-23T07:20:04.321 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-01-23T07:20:04.383 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-01-23T07:20:04.421 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/36 2024-01-23T07:20:04.481 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-01-23T07:20:04.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-01-23T07:20:04.723 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-01-23T07:20:04.777 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-01-23T07:20:04.864 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-01-23T07:20:04.961 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-01-23T07:20:05.001 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-01-23T07:20:05.117 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-01-23T07:20:05.273 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-779.g1d156303.el9.n 31/36 2024-01-23T07:20:05.303 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 32/36 2024-01-23T07:20:05.329 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 32/36 2024-01-23T07:20:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:20:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-23T07:20:05.329 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-23T07:20:05.330 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-23T07:20:05.330 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:06.762 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 33/36 2024-01-23T07:20:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 33/36 2024-01-23T07:20:06.789 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:20:06.789 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-23T07:20:06.789 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-23T07:20:06.789 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-23T07:20:06.789 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:07.247 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 34/36 2024-01-23T07:20:07.270 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 34/36 2024-01-23T07:20:07.270 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:20:07.270 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-23T07:20:07.270 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-23T07:20:07.270 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-23T07:20:07.270 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:07.480 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 35/36 2024-01-23T07:20:07.504 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 35/36 2024-01-23T07:20:07.504 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:20:07.504 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-23T07:20:07.504 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-23T07:20:07.504 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-23T07:20:07.504 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:07.569 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:19.0.0-779.g1d156303.el9.x86_64 36/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-2:19.0.0-779.g1d156303.el9.x86_64 36/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:19.0.0-779.g1d156303.el9.x86_64 1/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 2/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 3/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 4/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 5/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-779.g1d156303.el9.n 6/36 2024-01-23T07:20:09.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 11/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-01-23T07:20:09.310 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-01-23T07:20:09.311 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-01-23T07:20:09.311 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-01-23T07:20:09.311 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-01-23T07:20:09.311 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-01-23T07:20:09.311 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-01-23T07:20:09.311 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-01-23T07:20:09.311 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-01-23T07:20:09.312 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-01-23T07:20:09.312 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-01-23T07:20:09.312 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-01-23T07:20:09.313 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-01-23T07:20:09.313 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-01-23T07:20:09.313 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-01-23T07:20:09.313 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-01-23T07:20:09.313 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: lua-5.4.4-4.el9.x86_64 2024-01-23T07:20:10.460 INFO:teuthology.orchestra.run.smithi116.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-23T07:20:10.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ply-3.11-14.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-23T07:20:10.462 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:10.463 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:10.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-base 2024-01-23T07:20:11.425 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:43 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.717 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.718 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.719 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:11.720 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:11.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:11.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:11.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:11.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:11.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:11.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:11.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:11.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:11.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:11.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:11.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:11.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:11.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:11.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:11.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:11.730 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-base-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:20:11.784 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:11.785 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:20:11.785 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:11.847 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install cephadm 2024-01-23T07:20:12.436 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:44 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:12.726 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:12.726 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:12.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:12.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:12.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.733 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.734 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.735 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:12.735 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.735 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.735 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.735 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:12.791 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 742 k 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:12.792 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:12.793 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:20:12.793 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:12.793 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 742 k 2024-01-23T07:20:12.793 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 748 k 2024-01-23T07:20:12.793 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:13.312 INFO:teuthology.orchestra.run.smithi116.stdout:cephadm-19.0.0-779.g1d156303.el9.noarch.rpm 1.4 MB/s | 742 kB 00:00 2024-01-23T07:20:13.313 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:13.313 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.4 MB/s | 742 kB 00:00 2024-01-23T07:20:13.313 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:13.318 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:13.318 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:13.324 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:13.324 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:13.395 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:13.835 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:20:13.909 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:20:14.269 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:20:14.607 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:20:14.607 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:14.607 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:14.607 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:14.608 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:14.608 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:14.797 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-immutable-object-cache 2024-01-23T07:20:15.400 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:47 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:15.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:15.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.700 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.701 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.702 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:15.760 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-779.g1d156303.el9 ceph 145 k 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 145 k 2024-01-23T07:20:15.762 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 436 k 2024-01-23T07:20:15.762 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:16.935 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-immutable-object-cache-19.0.0-779.g1d15630 124 kB/s | 145 kB 00:01 2024-01-23T07:20:16.935 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:16.935 INFO:teuthology.orchestra.run.smithi116.stdout:Total 124 kB/s | 145 kB 00:01 2024-01-23T07:20:16.936 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:16.945 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:16.945 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:17.004 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:17.005 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:17.146 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:17.252 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-779.g1d156303.e 1/1 2024-01-23T07:20:17.276 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-779.g1d156303.e 1/1 2024-01-23T07:20:17.276 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:20:17.276 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-23T07:20:17.276 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:18.239 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-779.g1d156303.e 1/1 2024-01-23T07:20:18.239 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:18.239 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:18.239 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:18.239 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:18.239 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:18.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr 2024-01-23T07:20:19.080 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:51 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.373 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:19.374 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.375 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:19.376 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:19.377 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.378 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.379 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.380 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.381 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.382 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.382 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:19.382 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-mgr-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:20:19.437 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:19.438 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:20:19.438 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:19.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-dashboard 2024-01-23T07:20:20.096 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:52 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:20.390 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:20.391 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.392 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:20.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:20.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:20.456 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:20.457 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:20:20.457 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:20.457 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:20.457 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 1.7 M 2024-01-23T07:20:20.457 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 28 k 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 15 k 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout:Install 5 Packages 2024-01-23T07:20:20.458 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:20.459 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 2.0 M 2024-01-23T07:20:20.459 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 8.5 M 2024-01-23T07:20:20.459 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:20.988 INFO:teuthology.orchestra.run.smithi116.stdout:(1/5): ceph-grafana-dashboards-19.0.0-779.g1d15 62 kB/s | 28 kB 00:00 2024-01-23T07:20:21.022 INFO:teuthology.orchestra.run.smithi116.stdout:(2/5): ceph-prometheus-alerts-19.0.0-779.g1d156 31 kB/s | 15 kB 00:00 2024-01-23T07:20:21.222 INFO:teuthology.orchestra.run.smithi116.stdout:(3/5): python3-repoze-lru-0.7-16.el9.noarch.rpm 132 kB/s | 31 kB 00:00 2024-01-23T07:20:21.489 INFO:teuthology.orchestra.run.smithi116.stdout:(4/5): python3-routes-2.5.1-5.el9.noarch.rpm 404 kB/s | 188 kB 00:00 2024-01-23T07:20:22.055 INFO:teuthology.orchestra.run.smithi116.stdout:(5/5): ceph-mgr-dashboard-19.0.0-779.g1d156303. 1.1 MB/s | 1.7 MB 00:01 2024-01-23T07:20:22.057 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:22.058 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.2 MB/s | 2.0 MB 00:01 2024-01-23T07:20:22.058 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:22.065 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:22.065 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:22.133 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:22.133 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:22.372 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:22.462 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/5 2024-01-23T07:20:22.502 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/5 2024-01-23T07:20:22.532 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-779.g1d156303.el9.no 3/5 2024-01-23T07:20:22.766 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-779.g1d156303.el9.n 4/5 2024-01-23T07:20:22.809 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 5/5 2024-01-23T07:20:23.354 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 5/5 2024-01-23T07:20:23.354 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-779.g1d156303.el9.n 1/5 2024-01-23T07:20:23.354 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 2/5 2024-01-23T07:20:23.354 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-779.g1d156303.el9.no 3/5 2024-01-23T07:20:23.355 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 4/5 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 5/5 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-23T07:20:23.683 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-23T07:20:23.684 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:23.684 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:23.929 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-diskprediction-local 2024-01-23T07:20:24.562 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:07:56 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:24.864 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:24.865 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.866 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.867 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:24.868 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:24.869 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.870 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.871 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:24.872 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.873 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:24.935 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:24.936 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-01-23T07:20:24.936 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:20:24.936 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-01-23T07:20:24.936 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:24.936 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 7.4 M 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-01-23T07:20:24.937 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:24.938 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:24.938 INFO:teuthology.orchestra.run.smithi116.stdout:====================================================================================== 2024-01-23T07:20:24.938 INFO:teuthology.orchestra.run.smithi116.stdout:Install 12 Packages 2024-01-23T07:20:24.938 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:24.938 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 38 M 2024-01-23T07:20:24.939 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 209 M 2024-01-23T07:20:24.939 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:25.487 INFO:teuthology.orchestra.run.smithi116.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-01-23T07:20:25.529 INFO:teuthology.orchestra.run.smithi116.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 803 kB 00:00 2024-01-23T07:20:25.546 INFO:teuthology.orchestra.run.smithi116.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-01-23T07:20:25.580 INFO:teuthology.orchestra.run.smithi116.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 546 kB/s | 18 kB 00:00 2024-01-23T07:20:25.647 INFO:teuthology.orchestra.run.smithi116.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 25 MB/s | 3.0 MB 00:00 2024-01-23T07:20:25.672 INFO:teuthology.orchestra.run.smithi116.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 382 kB/s | 35 kB 00:00 2024-01-23T07:20:25.731 INFO:teuthology.orchestra.run.smithi116.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-01-23T07:20:25.797 INFO:teuthology.orchestra.run.smithi116.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 32 MB/s | 4.7 MB 00:00 2024-01-23T07:20:25.848 INFO:teuthology.orchestra.run.smithi116.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-01-23T07:20:25.940 INFO:teuthology.orchestra.run.smithi116.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 5.1 MB 00:00 2024-01-23T07:20:26.182 INFO:teuthology.orchestra.run.smithi116.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-01-23T07:20:26.823 INFO:teuthology.orchestra.run.smithi116.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-7 4.9 MB/s | 7.4 MB 00:01 2024-01-23T07:20:26.824 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:26.825 INFO:teuthology.orchestra.run.smithi116.stdout:Total 20 MB/s | 38 MB 00:01 2024-01-23T07:20:27.178 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:27.204 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:27.204 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:27.657 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:27.658 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:28.416 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:28.496 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-01-23T07:20:28.571 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-01-23T07:20:28.669 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-01-23T07:20:28.714 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-01-23T07:20:28.892 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-01-23T07:20:28.921 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-01-23T07:20:29.005 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-01-23T07:20:29.654 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-01-23T07:20:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-01-23T07:20:30.976 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-01-23T07:20:32.013 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-01-23T07:20:32.046 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-779.g1d1563 12/12 2024-01-23T07:20:34.654 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-779.g1d1563 12/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-779.g1d1563 1/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-01-23T07:20:34.655 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-23T07:20:35.117 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:35.118 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:35.494 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-rook 2024-01-23T07:20:36.098 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:08 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:36.393 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.394 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:36.395 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:36.396 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.397 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.398 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.402 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:36.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:36.460 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 51 k 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-23T07:20:36.461 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout:Install 13 Packages 2024-01-23T07:20:36.462 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:36.463 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 2.2 M 2024-01-23T07:20:36.463 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 26 M 2024-01-23T07:20:36.463 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:37.145 INFO:teuthology.orchestra.run.smithi116.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 70 kB/s | 19 kB 00:00 2024-01-23T07:20:37.170 INFO:teuthology.orchestra.run.smithi116.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 86 kB/s | 26 kB 00:00 2024-01-23T07:20:37.371 INFO:teuthology.orchestra.run.smithi116.stdout:(3/13): ceph-mgr-rook-19.0.0-779.g1d156303.el9. 102 kB/s | 51 kB 00:00 2024-01-23T07:20:37.513 INFO:teuthology.orchestra.run.smithi116.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 464 kB/s | 159 kB 00:00 2024-01-23T07:20:37.563 INFO:teuthology.orchestra.run.smithi116.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 532 kB/s | 222 kB 00:00 2024-01-23T07:20:37.621 INFO:teuthology.orchestra.run.smithi116.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 493 kB/s | 54 kB 00:00 2024-01-23T07:20:37.913 INFO:teuthology.orchestra.run.smithi116.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 51 kB/s | 15 kB 00:00 2024-01-23T07:20:37.939 INFO:teuthology.orchestra.run.smithi116.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 86 kB/s | 32 kB 00:00 2024-01-23T07:20:37.964 INFO:teuthology.orchestra.run.smithi116.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 470 kB/s | 279 kB 00:00 2024-01-23T07:20:38.247 INFO:teuthology.orchestra.run.smithi116.stdout:(10/13): python3-google-auth-2.26.2-1.el9.noarc 606 kB/s | 202 kB 00:00 2024-01-23T07:20:38.364 INFO:teuthology.orchestra.run.smithi116.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 770 kB/s | 90 kB 00:00 2024-01-23T07:20:38.389 INFO:teuthology.orchestra.run.smithi116.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 139 kB/s | 59 kB 00:00 2024-01-23T07:20:38.459 INFO:teuthology.orchestra.run.smithi116.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.0 MB/s | 1.0 MB 00:00 2024-01-23T07:20:38.460 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:38.460 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.1 MB/s | 2.2 MB 00:01 2024-01-23T07:20:38.522 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:38.537 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:38.537 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:38.637 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:38.637 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:39.151 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:39.311 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-01-23T07:20:39.373 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-01-23T07:20:39.437 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-01-23T07:20:39.475 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-01-23T07:20:39.516 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-01-23T07:20:39.610 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-01-23T07:20:39.719 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 7/13 2024-01-23T07:20:39.768 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-01-23T07:20:40.482 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-01-23T07:20:40.531 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-01-23T07:20:40.573 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-01-23T07:20:40.621 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-01-23T07:20:40.644 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 13/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 13/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 1/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-01-23T07:20:41.468 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-01-23T07:20:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-01-23T07:20:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-01-23T07:20:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 10/13 2024-01-23T07:20:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-01-23T07:20:41.469 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-01-23T07:20:41.606 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-common-debuginfo-19.0.0-779.g1d156303.el9. 5.7 MB/s | 411 MB 01:12 2024-01-23T07:20:41.607 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:41.607 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.7 MB/s | 411 MB 01:12 2024-01-23T07:20:41.607 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:20:41.611 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:20:41.611 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-23T07:20:41.879 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:41.880 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:42.158 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-cephadm 2024-01-23T07:20:42.760 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:14 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:43.053 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:43.054 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.055 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.056 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:43.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:43.119 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 133 k 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-01-23T07:20:43.120 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.11.3-4.el9 appstream 249 k 2024-01-23T07:20:43.121 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-23T07:20:43.121 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-23T07:20:43.121 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:43.121 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:43.121 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:43.121 INFO:teuthology.orchestra.run.smithi116.stdout:Install 6 Packages 2024-01-23T07:20:43.121 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:43.122 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 7.0 M 2024-01-23T07:20:43.122 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 33 M 2024-01-23T07:20:43.122 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:43.825 INFO:teuthology.orchestra.run.smithi116.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.6 MB/s | 249 kB 00:00 2024-01-23T07:20:44.001 INFO:teuthology.orchestra.run.smithi116.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-01-23T07:20:44.061 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:20:44.061 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:20:44.201 INFO:teuthology.orchestra.run.smithi116.stdout:(3/6): ceph-mgr-cephadm-19.0.0-779.g1d156303.el 250 kB/s | 133 kB 00:00 2024-01-23T07:20:44.242 INFO:teuthology.orchestra.run.smithi116.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 239 kB/s | 58 kB 00:00 2024-01-23T07:20:44.267 INFO:teuthology.orchestra.run.smithi116.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.2 MB/s | 548 kB 00:00 2024-01-23T07:20:44.293 INFO:teuthology.orchestra.run.smithi116.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 557 kB/s | 51 kB 00:00 2024-01-23T07:20:44.294 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:44.295 INFO:teuthology.orchestra.run.smithi116.stdout:Total 5.9 MB/s | 7.0 MB 00:01 2024-01-23T07:20:44.365 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:44.376 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:44.377 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:44.480 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:44.480 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:44.795 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:44.965 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-01-23T07:20:45.019 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-01-23T07:20:45.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-01-23T07:20:45.621 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-01-23T07:20:45.690 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-01-23T07:20:45.715 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 6/6 2024-01-23T07:20:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 6/6 2024-01-23T07:20:46.544 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 1/6 2024-01-23T07:20:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-01-23T07:20:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-01-23T07:20:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-01-23T07:20:46.545 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-01-23T07:20:46.883 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:46.884 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:47.112 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-fuse 2024-01-23T07:20:47.716 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:19 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:48.008 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:48.008 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:48.008 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:48.008 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.008 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:48.008 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:48.009 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:48.010 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:48.011 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.012 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:48.013 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.014 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.015 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:48.075 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:48.075 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:48.075 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:19.0.0-779.g1d156303.el9 ceph 886 k 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout:Install 2 Packages 2024-01-23T07:20:48.076 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:48.077 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 966 k 2024-01-23T07:20:48.077 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.8 M 2024-01-23T07:20:48.077 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:48.770 INFO:teuthology.orchestra.run.smithi116.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 200 kB/s | 80 kB 00:00 2024-01-23T07:20:49.253 INFO:teuthology.orchestra.run.smithi116.stdout:(2/2): ceph-fuse-19.0.0-779.g1d156303.el9.x86_6 1.0 MB/s | 886 kB 00:00 2024-01-23T07:20:49.254 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:49.254 INFO:teuthology.orchestra.run.smithi116.stdout:Total 820 kB/s | 966 kB 00:01 2024-01-23T07:20:49.266 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:49.288 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:49.288 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:49.369 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:49.369 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:49.566 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:49.704 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-01-23T07:20:49.778 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 2/2 2024-01-23T07:20:50.446 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 2/2 2024-01-23T07:20:50.447 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/2 2024-01-23T07:20:50.791 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-01-23T07:20:50.791 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:50.791 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:50.791 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:19.0.0-779.g1d156303.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-01-23T07:20:50.791 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:50.791 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:51.051 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-volume 2024-01-23T07:20:51.660 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:23 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:51.954 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:51.955 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.956 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.957 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:51.958 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.959 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:51.960 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.961 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:51.962 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:52.021 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:19.0.0-779.g1d156303.el9 ceph-noarch 262 k 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 262 k 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 1.2 M 2024-01-23T07:20:52.022 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:52.266 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-volume-19.0.0-779.g1d156303.el9.noarch.rpm 1.1 MB/s | 262 kB 00:00 2024-01-23T07:20:52.266 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:52.267 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.0 MB/s | 262 kB 00:00 2024-01-23T07:20:52.267 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:52.275 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:52.275 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:52.312 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:52.312 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:52.530 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:52.592 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:20:52.609 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:20:52.609 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:20:52.609 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-23T07:20:52.609 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:53.734 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 1/1 2024-01-23T07:20:53.734 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:53.734 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:53.735 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:19.0.0-779.g1d156303.el9.noarch 2024-01-23T07:20:53.735 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:53.735 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:54.036 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados-devel 2024-01-23T07:20:54.668 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:26 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:54.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:54.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:54.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:54.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:54.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:54.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:55.032 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:55.032 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:55.032 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:19.0.0-779.g1d156303.el9 ceph 127 k 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 127 k 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 456 k 2024-01-23T07:20:55.033 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:55.413 INFO:teuthology.orchestra.run.smithi116.stdout:librados-devel-19.0.0-779.g1d156303.el9.x86_64. 334 kB/s | 127 kB 00:00 2024-01-23T07:20:55.413 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:55.414 INFO:teuthology.orchestra.run.smithi116.stdout:Total 333 kB/s | 127 kB 00:00 2024-01-23T07:20:55.414 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:55.420 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:55.420 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:55.480 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:55.480 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:55.628 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:55.719 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:20:56.184 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:20:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:20:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:56.537 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:56.537 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:56.537 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:56.791 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs2 2024-01-23T07:20:57.397 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:29 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.691 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.692 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:57.693 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.694 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:57.695 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.696 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.697 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.698 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.699 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:57.700 INFO:teuthology.orchestra.run.smithi116.stdout:Package libcephfs2-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:20:57.758 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:57.759 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:20:57.759 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:20:57.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs-devel 2024-01-23T07:20:58.427 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:30 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:20:58.720 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:20:58.721 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:20:58.722 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:20:58.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:20:58.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:20:58.787 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:19.0.0-779.g1d156303.el9 ceph 31 k 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 31 k 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 140 k 2024-01-23T07:20:58.788 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:20:59.016 INFO:teuthology.orchestra.run.smithi116.stdout:libcephfs-devel-19.0.0-779.g1d156303.el9.x86_64 137 kB/s | 31 kB 00:00 2024-01-23T07:20:59.016 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:20:59.017 INFO:teuthology.orchestra.run.smithi116.stdout:Total 136 kB/s | 31 kB 00:00 2024-01-23T07:20:59.017 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:20:59.020 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:20:59.020 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:20:59.047 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:20:59.048 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:20:59.143 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:20:59.273 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:20:59.660 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:20:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:20:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:59.947 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:20:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:20:59.947 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:20:59.947 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:00.136 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados2 2024-01-23T07:21:00.739 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:32 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:01.032 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:01.032 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:01.032 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:01.032 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.032 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:01.032 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.032 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:01.033 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.034 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:01.035 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:01.036 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:01.037 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.038 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.039 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.040 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:01.041 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:21:01.099 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:01.100 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:21:01.100 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:01.166 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librbd1 2024-01-23T07:21:01.768 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:33 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:02.057 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:02.057 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:02.057 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:02.057 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:02.058 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.059 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.060 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:02.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:02.066 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:21:02.124 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:02.125 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:21:02.125 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:02.207 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rados 2024-01-23T07:21:02.804 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:34 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:03.096 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.097 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.098 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.099 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.100 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.101 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:03.102 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.103 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:03.104 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:03.105 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.106 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.106 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.106 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:03.106 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rados-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:21:03.163 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:03.164 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:21:03.164 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:03.231 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rgw 2024-01-23T07:21:03.826 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:35 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:04.118 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:04.118 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:04.118 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:04.118 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.118 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:04.119 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:04.120 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.121 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.122 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.123 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.124 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.125 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.126 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:04.127 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rgw-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:21:04.185 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:04.187 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:21:04.187 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:04.256 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-cephfs 2024-01-23T07:21:04.865 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:36 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:05.157 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:05.157 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:05.157 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:05.157 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.157 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:05.157 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:05.158 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.159 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:05.160 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:05.161 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:05.162 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.163 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.164 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.165 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.166 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:05.167 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-cephfs-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:21:05.224 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:05.225 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:21:05.225 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:05.329 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rbd 2024-01-23T07:21:05.927 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:37 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:06.220 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:06.220 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:06.220 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:06.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:06.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:06.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.227 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.228 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.229 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.229 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:06.229 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.229 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.229 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.229 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:06.229 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rbd-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:21:06.287 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:06.288 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:21:06.289 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:06.365 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-fuse 2024-01-23T07:21:06.969 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:38 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:07.261 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:07.261 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:07.261 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:07.261 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.261 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:07.261 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:07.262 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:07.263 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.264 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.265 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.266 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.267 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.268 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.269 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.270 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.270 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:07.270 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.270 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.270 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.270 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:07.328 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:19.0.0-779.g1d156303.el9 ceph 85 k 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:21:07.329 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:07.330 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 85 k 2024-01-23T07:21:07.330 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 231 k 2024-01-23T07:21:07.330 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:21:07.694 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-fuse-19.0.0-779.g1d156303.el9.x86_64.rpm 234 kB/s | 85 kB 00:00 2024-01-23T07:21:07.695 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:21:07.695 INFO:teuthology.orchestra.run.smithi116.stdout:Total 233 kB/s | 85 kB 00:00 2024-01-23T07:21:07.695 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:21:07.702 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:21:07.702 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:21:07.761 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:21:07.761 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:21:07.896 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:21:08.000 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:08.413 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:08.759 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:21:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:21:08.759 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:08.759 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:08.988 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-mirror 2024-01-23T07:21:09.593 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:41 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:09.884 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:09.884 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:09.884 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:09.885 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:09.886 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.887 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:09.888 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:09.889 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.890 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.891 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.892 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.893 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:09.952 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:09.952 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:09.952 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:21:09.952 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:09.952 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:21:09.952 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:19.0.0-779.g1d156303.el9 ceph 3.1 M 2024-01-23T07:21:09.953 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:09.953 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:21:09.953 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:09.953 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:21:09.953 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:09.953 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 3.1 M 2024-01-23T07:21:09.953 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 13 M 2024-01-23T07:21:09.954 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:21:11.998 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-mirror-19.0.0-779.g1d156303.el9.x86_64.rpm 1.5 MB/s | 3.1 MB 00:02 2024-01-23T07:21:11.999 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:21:11.999 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.5 MB/s | 3.1 MB 00:02 2024-01-23T07:21:11.999 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:21:12.010 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:21:12.010 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:21:12.089 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:21:12.090 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:21:12.510 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:21:12.574 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:12.598 INFO:teuthology.orchestra.run.smithi116.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-23T07:21:12.598 INFO:teuthology.orchestra.run.smithi116.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-23T07:21:12.598 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T07:21:12.598 INFO:teuthology.orchestra.run.smithi116.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-23T07:21:12.598 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:13.742 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:13.743 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:21:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:21:13.743 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:13.743 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:13.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-nbd 2024-01-23T07:21:14.607 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:46 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:14.897 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:14.897 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:14.897 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:14.898 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.899 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:14.900 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:14.901 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:14.902 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.903 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.904 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:14.905 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.906 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:14.965 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:19.0.0-779.g1d156303.el9 ceph 170 k 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:21:14.966 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:14.967 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 170 k 2024-01-23T07:21:14.967 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 490 k 2024-01-23T07:21:14.967 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:21:15.751 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-nbd-19.0.0-779.g1d156303.el9.x86_64.rpm 217 kB/s | 170 kB 00:00 2024-01-23T07:21:15.752 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:21:15.752 INFO:teuthology.orchestra.run.smithi116.stdout:Total 216 kB/s | 170 kB 00:00 2024-01-23T07:21:15.752 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:21:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:21:15.761 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:21:15.821 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:21:15.822 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:21:16.006 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:21:16.100 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:16.568 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:16.913 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:21:16.913 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:16.913 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:21:16.913 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:21:16.913 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:16.913 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:17.150 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-base-debuginfo 2024-01-23T07:21:17.762 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:08:49 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:18.061 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:18.061 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:18.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:18.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:18.061 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.061 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:18.062 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.063 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:18.064 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.065 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.066 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:18.067 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:18.068 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.069 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:18.128 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 67 M 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 22 M 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:18.129 INFO:teuthology.orchestra.run.smithi116.stdout:Install 2 Packages 2024-01-23T07:21:18.130 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 89 M 2024-01-23T07:21:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 490 M 2024-01-23T07:21:18.130 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:21:22.679 INFO:teuthology.orchestra.run.smithi116.stdout:(1/2): ceph-debuginfo-19.0.0-779.g1d156303.el9. 4.9 MB/s | 22 MB 00:04 2024-01-23T07:21:25.789 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:21:26.253 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:21:30.111 INFO:teuthology.orchestra.run.smithi116.stdout:(2/2): ceph-base-debuginfo-19.0.0-779.g1d156303 5.6 MB/s | 67 MB 00:11 2024-01-23T07:21:30.113 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:21:30.114 INFO:teuthology.orchestra.run.smithi116.stdout:Total 7.4 MB/s | 89 MB 00:11 2024-01-23T07:21:30.114 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:21:30.119 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:21:30.119 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:21:30.699 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:21:30.699 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:21:33.780 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:21:34.360 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:21:34.656 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:21:34.656 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:34.656 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:21:34.656 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:21:34.656 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:34.657 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:21:34.913 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-01-23T07:21:35.519 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:04:54 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:21:35.809 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:21:35.809 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:21:35.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:21:35.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.809 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:21:35.809 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.810 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.811 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.812 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:21:35.813 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.814 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.815 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.816 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.817 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.818 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:35.877 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:21:35.878 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-01-23T07:21:35.878 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:21:35.878 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-01-23T07:21:35.878 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:21:35.878 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.4 M 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.4 M 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 6.4 M 2024-01-23T07:21:35.879 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:21:36.705 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-debuginfo-19.0.0-77 1.7 MB/s | 1.4 MB 00:00 2024-01-23T07:21:36.705 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:21:36.706 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.7 MB/s | 1.4 MB 00:00 2024-01-23T07:21:36.706 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:21:36.710 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:21:36.710 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:21:36.752 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:21:36.752 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:21:37.004 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:21:37.096 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g 1/1 2024-01-23T07:21:37.561 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g 1/1 2024-01-23T07:21:37.841 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g 1/1 2024-01-23T07:21:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:37.842 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:21:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:21:37.842 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:37.842 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:21:38.051 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw-debuginfo 2024-01-23T07:21:38.651 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:04:57 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:21:38.940 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:21:38.940 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:21:38.941 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:21:38.942 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:21:38.943 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:21:38.944 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.945 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:38.946 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:38.947 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.948 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.949 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.950 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:38.950 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:39.007 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 170 M 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:21:39.008 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:21:39.009 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 170 M 2024-01-23T07:21:39.009 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 721 M 2024-01-23T07:21:39.009 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:21:40.755 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/2 2024-01-23T07:21:40.828 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 2/2 2024-01-23T07:21:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 2/2 2024-01-23T07:21:44.073 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/2 2024-01-23T07:21:44.395 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2/2 2024-01-23T07:21:44.395 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:44.395 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:21:44.395 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:21:44.395 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:21:44.395 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:44.395 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:21:44.627 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-common-debuginfo 2024-01-23T07:21:45.248 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:09:17 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:21:45.556 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:21:45.556 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:21:45.557 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:21:45.558 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:21:45.559 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:21:45.560 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:21:45.561 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.562 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.563 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.564 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.565 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:21:45.627 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:21:45.628 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:45.628 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 411 M 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 411 M 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 1.7 G 2024-01-23T07:21:45.629 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:21:58.248 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-radosgw-debuginfo-19.0.0-779.g1d156303.el9 8.9 MB/s | 170 MB 00:19 2024-01-23T07:21:58.249 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:21:58.249 INFO:teuthology.orchestra.run.smithi173.stdout:Total 8.9 MB/s | 170 MB 00:19 2024-01-23T07:21:58.249 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:21:58.253 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:21:58.253 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:21:59.280 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:21:59.280 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:22:16.614 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:22:16.701 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x8 1/1 2024-01-23T07:22:21.330 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x8 1/1 2024-01-23T07:22:21.629 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x8 1/1 2024-01-23T07:22:21.629 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:22:21.629 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:22:21.629 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:22:21.629 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:22:21.629 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:22:21.855 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test-debuginfo 2024-01-23T07:22:22.454 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:05:41 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:22:22.747 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:22:22.747 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:22:22.748 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.749 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:22:22.750 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.751 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.752 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.753 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.754 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.755 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.756 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.757 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:22:22.815 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:22:22.815 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 664 M 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 664 M 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 3.0 G 2024-01-23T07:22:22.816 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:23:23.755 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-common-debuginfo-19.0.0-779.g1d156303.el9. 4.2 MB/s | 411 MB 01:38 2024-01-23T07:23:23.756 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:23:23.756 INFO:teuthology.orchestra.run.smithi116.stdout:Total 4.2 MB/s | 411 MB 01:38 2024-01-23T07:23:23.756 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:23:23.760 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:23:23.760 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:23:26.212 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:23:26.212 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:24:07.607 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:24:07.698 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:24:12.502 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:24:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:24:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:12.804 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:24:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:24:12.804 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:12.804 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:24:13.061 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2024-01-23T07:24:13.683 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:11:45 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:24:13.984 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:24:13.984 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.985 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.986 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.987 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.988 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.989 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.990 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:24:13.991 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.992 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.993 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:24:13.994 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.994 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.994 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:24:13.994 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:24:14.054 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:24:14.054 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-01-23T07:24:14.054 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:24:14.054 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.4 M 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:14.055 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 1.4 M 2024-01-23T07:24:14.056 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 6.4 M 2024-01-23T07:24:14.056 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:24:15.078 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-immutable-object-cache-debuginfo-19.0.0-77 1.4 MB/s | 1.4 MB 00:01 2024-01-23T07:24:15.079 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:24:15.079 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.4 MB/s | 1.4 MB 00:01 2024-01-23T07:24:15.079 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:24:15.083 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:24:15.083 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:24:15.125 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:24:15.125 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:24:15.374 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:24:15.484 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g 1/1 2024-01-23T07:24:15.924 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g 1/1 2024-01-23T07:24:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g 1/1 2024-01-23T07:24:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:16.226 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:24:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:24:16.226 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:16.226 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:24:16.447 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw-debuginfo 2024-01-23T07:24:17.046 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:11:49 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:24:17.335 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:24:17.335 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:24:17.335 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.336 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.337 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.338 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.339 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:24:17.340 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:24:17.341 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.342 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.343 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.344 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.345 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.346 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.346 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:24:17.403 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 170 M 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:24:17.404 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:24:17.405 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:24:17.405 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 170 M 2024-01-23T07:24:17.405 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 721 M 2024-01-23T07:24:17.405 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:24:52.811 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-radosgw-debuginfo-19.0.0-779.g1d156303.el9 4.8 MB/s | 170 MB 00:35 2024-01-23T07:24:52.811 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:24:52.812 INFO:teuthology.orchestra.run.smithi116.stdout:Total 4.8 MB/s | 170 MB 00:35 2024-01-23T07:24:52.812 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:24:52.815 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:24:52.815 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:24:53.848 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:24:53.849 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:25:11.549 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:25:11.648 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x8 1/1 2024-01-23T07:25:16.056 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x8 1/1 2024-01-23T07:25:16.343 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x8 1/1 2024-01-23T07:25:16.343 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:25:16.344 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:25:16.344 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:25:16.344 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:25:16.344 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:25:16.553 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-test-debuginfo 2024-01-23T07:25:17.154 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:12:49 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:25:17.447 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:25:17.447 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:25:17.447 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:25:17.447 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.447 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:25:17.447 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.447 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.448 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.449 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:25:17.450 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.451 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:25:17.452 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:25:17.453 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.454 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:25:17.455 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.456 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.457 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.457 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:25:17.457 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.457 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.457 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.457 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:25:17.514 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:25:17.515 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:25:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:25:17.515 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:25:17.515 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:25:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 664 M 2024-01-23T07:25:17.515 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:25:17.515 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:25:17.516 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:25:17.516 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:25:17.516 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:25:17.516 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 664 M 2024-01-23T07:25:17.516 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 3.0 G 2024-01-23T07:25:17.516 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:25:54.671 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-test-debuginfo-19.0.0-779.g1d156303.el9.x8 3.1 MB/s | 664 MB 03:31 2024-01-23T07:25:54.672 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:25:54.672 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.1 MB/s | 664 MB 03:31 2024-01-23T07:25:54.672 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:25:54.677 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:25:54.677 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:25:58.600 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:25:58.601 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:26:57.033 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-test-debuginfo-19.0.0-779.g1d156303.el9.x8 6.7 MB/s | 664 MB 01:39 2024-01-23T07:26:57.033 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:26:57.034 INFO:teuthology.orchestra.run.smithi116.stdout:Total 6.7 MB/s | 664 MB 01:39 2024-01-23T07:26:57.034 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:26:57.038 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:26:57.039 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:27:00.958 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:27:00.958 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:27:08.795 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:27:09.404 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:27:17.246 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:27:17.538 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:27:17.539 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:17.539 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:27:17.539 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:27:17.539 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:17.539 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:27:17.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base-debuginfo 2024-01-23T07:27:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:10:37 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:27:18.717 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:27:18.717 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:27:18.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:27:18.717 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.717 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.718 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:27:18.719 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:27:18.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:27:18.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:27:18.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:27:18.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:27:18.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:27:18.729 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:27:18.785 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:27:18.786 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2024-01-23T07:27:18.786 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:27:18.872 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-debuginfo 2024-01-23T07:27:19.476 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:10:38 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:27:19.768 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:27:19.768 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:27:19.768 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:27:19.768 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.768 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:27:19.768 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.768 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.769 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:27:19.770 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:27:19.771 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.772 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:27:19.773 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.774 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.775 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.776 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.777 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:27:19.836 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:27:19.837 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:19.837 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:27:19.837 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:19.837 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 20 M 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 20 M 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 102 M 2024-01-23T07:27:19.838 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:27:22.989 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-mgr-debuginfo-19.0.0-779.g1d156303.el9.x86 6.2 MB/s | 20 MB 00:03 2024-01-23T07:27:22.990 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:27:22.990 INFO:teuthology.orchestra.run.smithi173.stdout:Total 6.2 MB/s | 20 MB 00:03 2024-01-23T07:27:22.991 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:27:22.994 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:27:22.995 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:27:23.144 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:27:23.145 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:27:25.361 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:27:25.462 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:27:26.514 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:27:26.804 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:27:26.804 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:26.804 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:27:26.804 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:27:26.804 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:26.804 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:27:27.013 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mds-debuginfo 2024-01-23T07:27:27.616 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:10:46 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:27:27.912 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.913 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.914 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.915 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:27:27.916 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:27:27.917 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.918 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.919 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.920 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.921 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.921 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:27:27.980 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:27:27.980 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 48 M 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:27:27.981 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:27.982 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 48 M 2024-01-23T07:27:27.982 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 173 M 2024-01-23T07:27:27.982 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:27:47.023 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-mds-debuginfo-19.0.0-779.g1d156303.el9.x86 2.5 MB/s | 48 MB 00:19 2024-01-23T07:27:47.024 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:27:47.024 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.5 MB/s | 48 MB 00:19 2024-01-23T07:27:47.024 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:27:47.028 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:27:47.028 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:27:47.343 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:27:47.344 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:27:52.144 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:27:52.304 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:27:53.642 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:27:53.936 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:27:53.937 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:53.937 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:27:53.937 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:27:53.937 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:53.937 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:27:54.153 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mon-debuginfo 2024-01-23T07:27:54.756 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:11:13 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:27:55.049 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:27:55.049 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:27:55.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:27:55.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:27:55.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:27:55.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:27:55.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:27:55.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:27:55.116 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:27:55.117 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:55.117 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:27:55.117 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 99 M 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 99 M 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 449 M 2024-01-23T07:27:55.118 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:28:10.473 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-mon-debuginfo-19.0.0-779.g1d156303.el9.x86 6.4 MB/s | 99 MB 00:15 2024-01-23T07:28:10.474 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:28:10.474 INFO:teuthology.orchestra.run.smithi173.stdout:Total 6.4 MB/s | 99 MB 00:15 2024-01-23T07:28:10.474 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:28:10.478 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:28:10.478 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:28:10.778 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:28:10.903 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:28:11.092 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:28:11.093 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:28:19.804 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:28:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:28:20.107 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:20.108 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:28:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:28:20.108 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:20.108 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:28:20.407 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-base-debuginfo 2024-01-23T07:28:21.007 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:15:53 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:28:21.301 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:28:21.301 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:28:21.301 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:28:21.301 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.301 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:28:21.302 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:28:21.303 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.304 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:28:21.305 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.306 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:28:21.307 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.308 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:28:21.309 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:28:21.310 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-base-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 is already installed. 2024-01-23T07:28:21.338 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:28:21.370 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:28:21.371 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2024-01-23T07:28:21.371 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:28:21.436 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-debuginfo 2024-01-23T07:28:21.445 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:22.034 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:15:54 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:28:22.327 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:28:22.328 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.329 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.330 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.331 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.332 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:28:22.333 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.334 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.335 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:28:22.396 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 20 M 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 20 M 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 102 M 2024-01-23T07:28:22.397 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:28:24.392 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:24.688 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:24.688 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:28:24.688 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:28:24.688 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:28:24.688 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:28:24.688 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:28:24.895 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-osd-debuginfo 2024-01-23T07:28:25.494 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:11:44 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:28:25.787 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.788 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:28:25.789 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:28:25.790 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.791 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.792 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.793 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.794 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.795 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.796 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.797 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:28:25.797 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.797 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.797 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.797 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:28:25.853 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:28:25.854 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:28:25.854 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:28:25.854 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:28:25.854 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:28:25.854 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 286 M 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 286 M 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.2 G 2024-01-23T07:28:25.855 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:28:25.918 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-mgr-debuginfo-19.0.0-779.g1d156303.el9.x86 5.6 MB/s | 20 MB 00:03 2024-01-23T07:28:25.919 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:28:25.919 INFO:teuthology.orchestra.run.smithi116.stdout:Total 5.6 MB/s | 20 MB 00:03 2024-01-23T07:28:25.919 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:28:25.923 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:28:25.924 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:28:26.074 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:28:26.074 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:28:28.307 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:28:28.491 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:29.628 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:29.925 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:29.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:29.925 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:28:29.925 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:28:29.925 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:29.925 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:28:30.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mds-debuginfo 2024-01-23T07:28:30.721 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:16:02 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:28:31.015 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:28:31.016 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:28:31.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:28:31.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:28:31.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:28:31.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.023 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:28:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:28:31.083 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 48 M 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:28:31.084 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:31.085 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 48 M 2024-01-23T07:28:31.085 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 173 M 2024-01-23T07:28:31.085 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:28:36.928 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-mds-debuginfo-19.0.0-779.g1d156303.el9.x86 8.2 MB/s | 48 MB 00:05 2024-01-23T07:28:36.929 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:28:36.929 INFO:teuthology.orchestra.run.smithi116.stdout:Total 8.2 MB/s | 48 MB 00:05 2024-01-23T07:28:36.929 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:28:36.933 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:28:36.933 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:28:37.248 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:28:37.248 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:28:42.034 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:28:42.134 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:43.535 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:28:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:43.839 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:28:43.839 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:28:43.840 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:43.840 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:28:44.034 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mon-debuginfo 2024-01-23T07:28:44.632 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:16:16 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:28:44.927 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:28:44.927 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:28:44.927 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:28:44.928 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:28:44.929 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:28:44.930 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:28:44.931 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:28:44.932 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.933 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.934 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.935 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.936 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:28:44.936 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.936 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.936 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.937 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.938 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:28:44.994 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 99 M 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:28:44.995 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:28:44.996 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:28:44.996 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 99 M 2024-01-23T07:28:44.996 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 449 M 2024-01-23T07:28:44.996 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:28:50.496 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-osd-debuginfo-19.0.0-779.g1d156303.el9.x86 12 MB/s | 286 MB 00:24 2024-01-23T07:28:50.497 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:28:50.497 INFO:teuthology.orchestra.run.smithi173.stdout:Total 12 MB/s | 286 MB 00:24 2024-01-23T07:28:50.498 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:28:50.502 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:28:50.502 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:28:52.213 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:28:52.213 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:28:52.863 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-mon-debuginfo-19.0.0-779.g1d156303.el9.x86 13 MB/s | 99 MB 00:07 2024-01-23T07:28:52.864 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:28:52.864 INFO:teuthology.orchestra.run.smithi116.stdout:Total 13 MB/s | 99 MB 00:07 2024-01-23T07:28:52.864 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:28:52.868 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:28:52.868 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:28:53.479 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:28:53.479 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:29:03.699 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:29:03.800 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:29:06.627 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:29:06.926 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:29:06.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:29:06.926 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:29:06.926 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:29:06.926 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:29:06.926 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:29:07.125 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-osd-debuginfo 2024-01-23T07:29:07.725 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:16:39 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:29:08.017 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:29:08.017 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:29:08.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:29:08.017 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.017 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.018 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.019 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:29:08.020 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.021 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:29:08.022 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.023 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.024 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.025 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.026 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.026 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.026 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:29:08.026 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.026 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.026 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.026 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:29:08.085 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:29:08.085 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:29:08.085 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:29:08.085 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:29:08.085 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 286 M 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 286 M 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 1.2 G 2024-01-23T07:29:08.086 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:29:21.414 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:29:21.515 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:29:22.288 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-osd-debuginfo-19.0.0-779.g1d156303.el9.x86 20 MB/s | 286 MB 00:14 2024-01-23T07:29:22.288 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:29:22.289 INFO:teuthology.orchestra.run.smithi116.stdout:Total 20 MB/s | 286 MB 00:14 2024-01-23T07:29:22.289 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:29:22.293 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:29:22.293 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:29:24.013 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:29:24.013 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:29:29.164 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:29:29.473 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:29:29.473 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:29.473 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:29:29.473 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:29:29.474 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:29.474 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:29:29.698 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse-debuginfo 2024-01-23T07:29:30.299 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:12:49 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:29:30.589 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:29:30.589 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:29:30.589 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:29:30.590 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:29:30.591 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.592 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:29:30.593 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:29:30.594 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.595 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:29:30.596 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.597 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.598 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:29:30.656 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:29:30.656 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 5.9 M 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 5.9 M 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 28 M 2024-01-23T07:29:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:29:31.662 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-fuse-debuginfo-19.0.0-779.g1d156303.el9.x8 5.9 MB/s | 5.9 MB 00:01 2024-01-23T07:29:31.662 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:29:31.663 INFO:teuthology.orchestra.run.smithi173.stdout:Total 5.9 MB/s | 5.9 MB 00:01 2024-01-23T07:29:31.663 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:29:31.666 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:29:31.666 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:29:31.735 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:29:31.735 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:29:32.467 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:29:32.560 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:29:33.122 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:29:33.417 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:29:33.417 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:33.417 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:29:33.417 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:29:33.417 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:33.417 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:29:33.598 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel-debuginfo 2024-01-23T07:29:34.202 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:12:53 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:29:34.494 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:29:34.495 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.496 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.497 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:29:34.498 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.499 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:29:34.500 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.501 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.502 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.503 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.504 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:29:34.560 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:29:34.560 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 108 k 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 108 k 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 439 k 2024-01-23T07:29:34.561 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:29:34.789 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-debuginfo-19.0.0-779.g1d156303.e 476 kB/s | 108 kB 00:00 2024-01-23T07:29:34.790 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:29:34.790 INFO:teuthology.orchestra.run.smithi173.stdout:Total 473 kB/s | 108 kB 00:00 2024-01-23T07:29:34.791 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:29:34.794 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:29:34.794 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:29:34.828 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:29:34.828 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:29:34.956 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:29:35.055 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:29:35.451 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:29:35.749 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:29:35.749 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:29:35.749 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:29:35.749 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:29:35.942 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2-debuginfo 2024-01-23T07:29:36.541 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:12:55 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:29:36.834 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:29:36.834 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:29:36.834 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:29:36.834 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.835 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:29:36.836 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:29:36.837 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:29:36.838 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:29:36.839 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.840 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.841 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.842 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.843 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:29:36.901 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:29:36.901 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:36.901 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:29:36.901 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:36.901 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:29:36.901 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 5.3 M 2024-01-23T07:29:36.902 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:36.902 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:29:36.902 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:36.902 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:29:36.902 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:36.903 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 5.3 M 2024-01-23T07:29:36.903 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 25 M 2024-01-23T07:29:36.903 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:29:39.559 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs2-debuginfo-19.0.0-779.g1d156303.el9.x 2.0 MB/s | 5.3 MB 00:02 2024-01-23T07:29:39.559 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:29:39.560 INFO:teuthology.orchestra.run.smithi173.stdout:Total 2.0 MB/s | 5.3 MB 00:02 2024-01-23T07:29:39.560 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:29:39.564 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:29:39.564 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:29:39.633 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:29:39.634 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:29:40.294 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:29:40.399 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:29:40.918 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:29:41.233 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:29:41.234 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:41.234 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:29:41.234 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:29:41.234 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:41.234 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:29:41.426 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2-debuginfo 2024-01-23T07:29:42.030 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:01 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:29:42.323 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:29:42.323 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:29:42.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:29:42.323 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.323 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.324 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.325 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:29:42.326 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:29:42.327 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:29:42.328 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.329 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.330 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.331 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.332 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.333 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:29:42.391 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 44 M 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 44 M 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 252 M 2024-01-23T07:29:42.392 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:29:46.928 INFO:teuthology.orchestra.run.smithi173.stdout:librados2-debuginfo-19.0.0-779.g1d156303.el9.x8 9.7 MB/s | 44 MB 00:04 2024-01-23T07:29:46.929 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:29:46.929 INFO:teuthology.orchestra.run.smithi173.stdout:Total 9.7 MB/s | 44 MB 00:04 2024-01-23T07:29:46.929 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:29:46.933 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:29:46.933 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:29:47.239 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:29:47.239 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:29:52.271 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:29:52.367 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:29:53.406 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:29:53.508 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:29:54.279 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:29:54.585 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:29:54.585 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:54.585 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:29:54.586 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:29:54.586 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:54.586 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:29:54.825 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1-debuginfo 2024-01-23T07:29:55.429 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:14 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:29:55.720 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:29:55.720 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:29:55.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:29:55.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.720 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:29:55.720 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:29:55.721 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:29:55.722 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.723 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:29:55.724 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.725 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.726 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.727 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.728 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.729 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:29:55.785 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:29:55.786 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:55.786 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:29:55.786 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:55.786 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:29:55.786 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 52 M 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 52 M 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 308 M 2024-01-23T07:29:55.787 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:00.794 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:01.095 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:01.096 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:30:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:01.096 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:01.096 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:30:01.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-fuse-debuginfo 2024-01-23T07:30:01.924 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:17:33 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:30:02.215 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:30:02.215 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:30:02.215 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:30:02.215 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.215 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:30:02.216 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.216 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:30:02.216 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.216 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:30:02.216 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.216 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.217 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.218 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.219 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:30:02.220 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.221 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.222 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.223 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.224 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:02.225 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.226 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:02.282 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 5.9 M 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 5.9 M 2024-01-23T07:30:02.283 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 28 M 2024-01-23T07:30:02.284 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:30:05.545 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-fuse-debuginfo-19.0.0-779.g1d156303.el9.x8 1.8 MB/s | 5.9 MB 00:03 2024-01-23T07:30:05.546 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:05.546 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.8 MB/s | 5.9 MB 00:03 2024-01-23T07:30:05.546 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:30:05.550 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:30:05.550 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:30:05.622 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:30:05.623 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:30:06.356 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:30:06.462 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:30:07.014 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:30:07.325 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:30:07.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:07.326 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:30:07.326 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:07.326 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:07.326 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:30:07.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados-devel-debuginfo 2024-01-23T07:30:08.127 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:17:40 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:30:08.418 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:30:08.418 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:30:08.419 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.420 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:30:08.421 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:30:08.422 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.423 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.424 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.425 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:08.426 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.427 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:08.485 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:30:08.486 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:08.486 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:30:08.486 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:08.486 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:30:08.486 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 108 k 2024-01-23T07:30:08.486 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:08.486 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:30:08.487 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:08.487 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:30:08.487 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:08.487 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 108 k 2024-01-23T07:30:08.487 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 439 k 2024-01-23T07:30:08.487 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:30:08.845 INFO:teuthology.orchestra.run.smithi173.stdout:librbd1-debuginfo-19.0.0-779.g1d156303.el9.x86_ 4.0 MB/s | 52 MB 00:13 2024-01-23T07:30:08.846 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:08.846 INFO:teuthology.orchestra.run.smithi173.stdout:Total 4.0 MB/s | 52 MB 00:13 2024-01-23T07:30:08.847 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:08.851 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:08.851 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:08.922 INFO:teuthology.orchestra.run.smithi116.stdout:librados-devel-debuginfo-19.0.0-779.g1d156303.e 249 kB/s | 108 kB 00:00 2024-01-23T07:30:08.923 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:08.923 INFO:teuthology.orchestra.run.smithi116.stdout:Total 248 kB/s | 108 kB 00:00 2024-01-23T07:30:08.923 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:30:08.926 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:30:08.926 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:30:08.961 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:30:08.962 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:30:09.073 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:30:09.163 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:30:09.201 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:09.201 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:09.552 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:30:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:30:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:09.861 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:30:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:09.861 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:09.861 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:30:10.079 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs2-debuginfo 2024-01-23T07:30:10.675 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:17:42 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:30:10.964 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:30:10.965 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.966 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:30:10.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:30:10.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.967 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:30:10.967 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:30:10.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.974 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:10.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:10.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:11.031 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:30:11.031 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:11.031 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:30:11.031 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 5.3 M 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 5.3 M 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 25 M 2024-01-23T07:30:11.032 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:30:13.159 INFO:teuthology.orchestra.run.smithi116.stdout:libcephfs2-debuginfo-19.0.0-779.g1d156303.el9.x 2.5 MB/s | 5.3 MB 00:02 2024-01-23T07:30:13.159 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:13.160 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.5 MB/s | 5.3 MB 00:02 2024-01-23T07:30:13.160 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:30:13.164 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:30:13.164 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:30:13.234 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:30:13.234 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:30:13.901 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:30:14.007 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:30:14.539 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:30:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:30:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:14.858 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:30:14.858 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:14.859 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:14.859 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:30:15.072 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados2-debuginfo 2024-01-23T07:30:15.213 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:15.410 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:15.675 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:17:47 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:30:15.967 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:30:15.967 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.968 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:30:15.969 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:30:15.970 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:30:15.971 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:30:15.972 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.973 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.974 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.975 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:15.976 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.976 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.976 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:15.976 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:16.034 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:30:16.034 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 44 M 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 44 M 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 252 M 2024-01-23T07:30:16.035 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:30:17.596 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:17.886 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:17.887 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:18.109 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs-debuginfo 2024-01-23T07:30:18.707 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:37 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:30:18.995 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.996 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:30:18.997 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:30:18.998 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:30:18.999 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:30:19.000 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:19.001 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.002 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.003 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.004 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.005 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.005 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:19.060 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 615 k 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:30:19.061 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:19.062 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 615 k 2024-01-23T07:30:19.062 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.1 M 2024-01-23T07:30:19.062 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:19.063 INFO:teuthology.orchestra.run.smithi116.stdout:librados2-debuginfo-19.0.0-779.g1d156303.el9.x8 15 MB/s | 44 MB 00:03 2024-01-23T07:30:19.063 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:19.063 INFO:teuthology.orchestra.run.smithi116.stdout:Total 15 MB/s | 44 MB 00:03 2024-01-23T07:30:19.063 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:30:19.066 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:30:19.066 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:30:19.368 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:30:19.369 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:30:19.465 INFO:teuthology.orchestra.run.smithi173.stdout:python3-cephfs-debuginfo-19.0.0-779.g1d156303.e 1.5 MB/s | 615 kB 00:00 2024-01-23T07:30:19.465 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:19.466 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.5 MB/s | 615 kB 00:00 2024-01-23T07:30:19.466 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:19.469 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:19.469 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:19.506 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:19.506 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:19.672 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:19.771 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:30:20.174 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:30:20.459 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:30:20.460 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:20.460 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:20.460 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:20.460 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:20.460 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:20.668 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados-debuginfo 2024-01-23T07:30:21.273 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:40 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.564 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.565 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.566 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.567 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:30:21.568 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.569 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:21.570 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.571 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:21.572 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.573 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.573 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.573 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:21.629 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 769 k 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:21.630 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 769 k 2024-01-23T07:30:21.631 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.7 M 2024-01-23T07:30:21.631 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:22.584 INFO:teuthology.orchestra.run.smithi173.stdout:python3-rados-debuginfo-19.0.0-779.g1d156303.el 807 kB/s | 769 kB 00:00 2024-01-23T07:30:22.584 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:22.585 INFO:teuthology.orchestra.run.smithi173.stdout:Total 806 kB/s | 769 kB 00:00 2024-01-23T07:30:22.585 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:22.589 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:22.589 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:22.629 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:22.630 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:22.809 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:22.907 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x 1/1 2024-01-23T07:30:23.284 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x 1/1 2024-01-23T07:30:23.575 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x 1/1 2024-01-23T07:30:23.576 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:23.576 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:23.576 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:23.576 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:23.576 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:23.785 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd-debuginfo 2024-01-23T07:30:24.385 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:43 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:30:24.388 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:30:24.484 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:30:24.679 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:30:24.680 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:30:24.681 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:30:24.682 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:30:24.683 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:30:24.684 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.685 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:24.686 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.687 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:24.688 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.688 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.688 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.688 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:24.745 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:30:24.746 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:24.746 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:30:24.746 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:24.746 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.1 M 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.1 M 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 4.3 M 2024-01-23T07:30:24.747 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:25.903 INFO:teuthology.orchestra.run.smithi173.stdout:python3-rbd-debuginfo-19.0.0-779.g1d156303.el9. 996 kB/s | 1.1 MB 00:01 2024-01-23T07:30:25.904 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:25.904 INFO:teuthology.orchestra.run.smithi173.stdout:Total 994 kB/s | 1.1 MB 00:01 2024-01-23T07:30:25.905 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:25.908 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:25.909 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:25.952 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:25.956 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:26.171 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:26.261 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:30:26.322 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:30:26.624 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_6 1/1 2024-01-23T07:30:26.624 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:26.625 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:30:26.625 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:26.625 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:26.625 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:30:26.627 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:30:26.834 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librbd1-debuginfo 2024-01-23T07:30:26.926 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:30:26.926 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:26.926 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:26.926 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:26.926 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:26.926 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:27.156 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw-debuginfo 2024-01-23T07:30:27.433 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:17:59 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:30:27.723 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:30:27.723 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:30:27.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:30:27.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:30:27.723 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.723 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:30:27.724 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:30:27.725 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:30:27.726 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.727 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.728 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.729 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.730 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.731 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.732 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:27.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.732 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:27.759 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:46 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:30:27.788 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 52 M 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:30:27.789 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:27.790 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:30:27.790 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:27.790 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 52 M 2024-01-23T07:30:27.790 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 308 M 2024-01-23T07:30:27.790 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:30:28.049 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:30:28.050 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:30:28.051 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:30:28.052 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:30:28.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:30:28.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:30:28.053 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.053 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:30:28.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:30:28.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:30:28.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.054 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:30:28.054 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:30:28.055 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:30:28.056 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:28.057 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.058 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:28.059 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.060 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.061 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:28.115 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 337 k 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:30:28.116 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:28.117 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 337 k 2024-01-23T07:30:28.117 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.0 M 2024-01-23T07:30:28.117 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:29.048 INFO:teuthology.orchestra.run.smithi173.stdout:python3-rgw-debuginfo-19.0.0-779.g1d156303.el9. 363 kB/s | 337 kB 00:00 2024-01-23T07:30:29.048 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:29.049 INFO:teuthology.orchestra.run.smithi173.stdout:Total 362 kB/s | 337 kB 00:00 2024-01-23T07:30:29.049 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:29.053 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:29.053 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:29.092 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:29.093 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:29.230 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:29.330 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:30:29.700 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:30:29.996 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:30:29.997 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:29.997 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:29.997 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:29.997 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:29.997 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:30.206 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse-debuginfo 2024-01-23T07:30:30.811 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:49 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:30:31.103 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.104 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.105 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.106 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:30:31.107 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.108 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.109 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.110 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.111 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.112 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:31.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.112 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:31.170 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:30:31.170 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 509 k 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 509 k 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.5 M 2024-01-23T07:30:31.171 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:31.459 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-debuginfo-19.0.0-779.g1d156303.el9.x86 1.7 MB/s | 509 kB 00:00 2024-01-23T07:30:31.460 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:31.460 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.7 MB/s | 509 kB 00:00 2024-01-23T07:30:31.460 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:31.463 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:31.463 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:31.501 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:31.502 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:31.659 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:31.767 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:32.129 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:32.418 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:32.418 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:32.418 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:32.631 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror-debuginfo 2024-01-23T07:30:33.232 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:13:52 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:30:33.526 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:30:33.527 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.528 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:30:33.529 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:30:33.530 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:30:33.531 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.532 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.532 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.532 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.533 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.534 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.535 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.536 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.536 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:33.593 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:30:33.593 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 52 M 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:30:33.594 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:33.595 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 52 M 2024-01-23T07:30:33.595 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 298 M 2024-01-23T07:30:33.595 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-debuginfo-19.0.0-779.g1d156303.el9.x 13 MB/s | 52 MB 00:03 2024-01-23T07:30:37.546 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:Total 13 MB/s | 52 MB 00:03 2024-01-23T07:30:37.547 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:37.551 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:37.886 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:37.887 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:43.763 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:43.851 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:30:45.970 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:30:46.269 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:30:46.269 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:46.269 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:46.269 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:46.269 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:46.270 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:46.474 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd-debuginfo 2024-01-23T07:30:47.080 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:14:06 ago on Tue 23 Jan 2024 07:16:41 AM UTC. 2024-01-23T07:30:47.373 INFO:teuthology.orchestra.run.smithi173.stderr:Modular dependency problems: 2024-01-23T07:30:47.374 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:30:47.374 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 1: conflicting requests 2024-01-23T07:30:47.374 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.374 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 2: conflicting requests 2024-01-23T07:30:47.374 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.374 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 3: conflicting requests 2024-01-23T07:30:47.374 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 4: conflicting requests 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 5: conflicting requests 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 6: conflicting requests 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 7: conflicting requests 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 8: conflicting requests 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 9: conflicting requests 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.375 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 10: conflicting requests 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 11: conflicting requests 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 12: conflicting requests 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 13: conflicting requests 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 14: conflicting requests 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 15: conflicting requests 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.376 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 16: conflicting requests 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 17: conflicting requests 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 18: conflicting requests 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 19: conflicting requests 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 20: conflicting requests 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 21: conflicting requests 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 22: conflicting requests 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.377 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 23: conflicting requests 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 24: conflicting requests 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 25: conflicting requests 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 26: conflicting requests 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 27: conflicting requests 2024-01-23T07:30:47.378 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 28: conflicting requests 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 29: conflicting requests 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 30: conflicting requests 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 31: conflicting requests 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 32: conflicting requests 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 33: conflicting requests 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 34: conflicting requests 2024-01-23T07:30:47.379 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 35: conflicting requests 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 36: conflicting requests 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 37: conflicting requests 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.380 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 39: conflicting requests 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.381 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.382 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.383 INFO:teuthology.orchestra.run.smithi173.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:47.439 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-01-23T07:30:47.441 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:47.441 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2024-01-23T07:30:47.441 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:47.441 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-01-23T07:30:47.442 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.3 M 2024-01-23T07:30:47.442 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:47.442 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-01-23T07:30:47.442 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-01-23T07:30:47.442 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2024-01-23T07:30:47.442 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:47.443 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.3 M 2024-01-23T07:30:47.443 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 5.5 M 2024-01-23T07:30:47.443 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-01-23T07:30:48.305 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-debuginfo-19.0.0-779.g1d156303.el9.x86_ 1.4 MB/s | 1.3 MB 00:00 2024-01-23T07:30:48.306 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:48.306 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.4 MB/s | 1.3 MB 00:00 2024-01-23T07:30:48.306 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-01-23T07:30:48.310 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-01-23T07:30:48.310 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-01-23T07:30:48.354 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-01-23T07:30:48.355 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-01-23T07:30:48.601 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-01-23T07:30:48.712 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:49.138 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:49.429 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-01-23T07:30:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:49.429 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:30:49.429 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-01-23T07:30:49.594 INFO:teuthology.orchestra.run.smithi116.stdout:librbd1-debuginfo-19.0.0-779.g1d156303.el9.x86_ 2.4 MB/s | 52 MB 00:21 2024-01-23T07:30:49.595 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:30:49.596 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.4 MB/s | 52 MB 00:21 2024-01-23T07:30:49.596 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:30:49.600 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:30:49.600 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:30:49.638 DEBUG:teuthology.parallel:result is None 2024-01-23T07:30:49.949 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:30:49.950 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:30:55.926 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:30:56.026 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:58.219 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:58.527 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:30:58.527 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:58.528 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:30:58.528 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:30:58.528 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:58.528 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:30:58.768 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-cephfs-debuginfo 2024-01-23T07:30:59.374 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:18:31 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:30:59.668 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:30:59.669 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:30:59.670 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.671 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:30:59.672 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.673 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:30:59.674 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.675 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:30:59.676 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.677 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.678 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:30:59.734 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 615 k 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:30:59.735 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:30:59.736 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 615 k 2024-01-23T07:30:59.736 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.1 M 2024-01-23T07:30:59.736 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:31:00.471 INFO:teuthology.orchestra.run.smithi116.stdout:python3-cephfs-debuginfo-19.0.0-779.g1d156303.e 837 kB/s | 615 kB 00:00 2024-01-23T07:31:00.472 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:31:00.472 INFO:teuthology.orchestra.run.smithi116.stdout:Total 835 kB/s | 615 kB 00:00 2024-01-23T07:31:00.472 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:31:00.476 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:31:00.476 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:31:00.514 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:31:00.514 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:31:00.683 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:31:00.778 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:31:01.177 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:31:01.502 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9. 1/1 2024-01-23T07:31:01.502 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:01.502 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:31:01.503 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:31:01.503 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:01.503 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:31:01.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rados-debuginfo 2024-01-23T07:31:02.311 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:18:34 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.600 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.601 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.602 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.603 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.604 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:31:02.605 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.605 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:31:02.605 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:31:02.606 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.607 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.608 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:31:02.609 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.610 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:31:02.666 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:31:02.666 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 769 k 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 769 k 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.7 M 2024-01-23T07:31:02.667 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:31:03.966 INFO:teuthology.orchestra.run.smithi116.stdout:python3-rados-debuginfo-19.0.0-779.g1d156303.el 592 kB/s | 769 kB 00:01 2024-01-23T07:31:03.967 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:31:03.967 INFO:teuthology.orchestra.run.smithi116.stdout:Total 592 kB/s | 769 kB 00:01 2024-01-23T07:31:03.967 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:31:03.971 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:31:03.971 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:31:04.014 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:31:04.014 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:31:04.197 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:31:04.305 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x 1/1 2024-01-23T07:31:04.686 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x 1/1 2024-01-23T07:31:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x 1/1 2024-01-23T07:31:04.991 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:04.992 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:31:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:31:04.992 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:04.992 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:31:05.177 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rbd-debuginfo 2024-01-23T07:31:05.780 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:18:37 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:31:06.070 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:31:06.070 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:31:06.070 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.071 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:31:06.072 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:31:06.073 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.074 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:31:06.075 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:31:06.076 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.077 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.078 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.079 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.080 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.081 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:31:06.137 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:31:06.137 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:06.137 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.1 M 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 1.1 M 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 4.3 M 2024-01-23T07:31:06.138 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:31:06.927 INFO:teuthology.orchestra.run.smithi116.stdout:python3-rbd-debuginfo-19.0.0-779.g1d156303.el9. 1.4 MB/s | 1.1 MB 00:00 2024-01-23T07:31:06.928 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:31:06.928 INFO:teuthology.orchestra.run.smithi116.stdout:Total 1.4 MB/s | 1.1 MB 00:00 2024-01-23T07:31:06.928 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:31:06.931 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:31:06.932 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:31:06.974 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:31:06.974 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:31:07.193 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:31:07.295 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:31:07.703 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:31:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:31:08.050 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:08.050 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:31:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:31:08.051 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:08.051 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:31:08.284 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rgw-debuginfo 2024-01-23T07:31:08.884 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:18:40 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:31:09.178 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:31:09.179 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.180 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:31:09.181 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.182 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.183 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.184 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.185 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.186 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.187 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:31:09.245 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 337 k 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:09.246 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 337 k 2024-01-23T07:31:09.247 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 1.0 M 2024-01-23T07:31:09.247 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:31:09.763 INFO:teuthology.orchestra.run.smithi116.stdout:python3-rgw-debuginfo-19.0.0-779.g1d156303.el9. 653 kB/s | 337 kB 00:00 2024-01-23T07:31:09.764 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:31:09.764 INFO:teuthology.orchestra.run.smithi116.stdout:Total 652 kB/s | 337 kB 00:00 2024-01-23T07:31:09.764 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:31:09.767 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:31:09.767 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:31:09.803 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:31:09.804 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:31:09.937 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:31:10.045 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:31:10.456 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:31:10.799 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86 1/1 2024-01-23T07:31:10.799 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:10.799 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:31:10.799 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:31:10.799 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:10.799 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:31:11.013 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-fuse-debuginfo 2024-01-23T07:31:11.617 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:18:43 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:31:11.909 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:31:11.909 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:31:11.909 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:31:11.909 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.909 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:31:11.910 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.911 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:31:11.912 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.913 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:31:11.914 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.915 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.916 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.917 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.918 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:31:11.976 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 509 k 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:31:11.977 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:11.978 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 509 k 2024-01-23T07:31:11.978 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.5 M 2024-01-23T07:31:11.978 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:31:12.625 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-fuse-debuginfo-19.0.0-779.g1d156303.el9.x86 786 kB/s | 509 kB 00:00 2024-01-23T07:31:12.626 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:31:12.626 INFO:teuthology.orchestra.run.smithi116.stdout:Total 785 kB/s | 509 kB 00:00 2024-01-23T07:31:12.626 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:31:12.629 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:31:12.629 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:31:12.667 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:31:12.668 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:31:12.826 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:31:12.916 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:31:13.352 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:31:13.680 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:13.681 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:31:13.899 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-mirror-debuginfo 2024-01-23T07:31:14.493 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:18:46 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:31:14.783 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:31:14.783 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.784 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:31:14.785 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.786 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:31:14.787 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.788 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:31:14.789 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.790 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.791 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.792 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:31:14.793 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.794 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.794 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.794 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:31:14.853 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 52 M 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:31:14.854 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:14.855 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 52 M 2024-01-23T07:31:14.855 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 298 M 2024-01-23T07:31:14.855 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:31:23.435 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-mirror-debuginfo-19.0.0-779.g1d156303.el9.x 6.0 MB/s | 52 MB 00:08 2024-01-23T07:31:23.436 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:31:23.436 INFO:teuthology.orchestra.run.smithi116.stdout:Total 6.0 MB/s | 52 MB 00:08 2024-01-23T07:31:23.437 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:31:23.440 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:31:23.441 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:31:23.776 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:31:23.777 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:31:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:31:29.891 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:31:31.953 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:31:32.274 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_ 1/1 2024-01-23T07:31:32.275 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:32.275 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:31:32.275 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:31:32.275 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:32.275 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:31:32.488 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-nbd-debuginfo 2024-01-23T07:31:33.092 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:19:05 ago on Tue 23 Jan 2024 07:12:28 AM UTC. 2024-01-23T07:31:33.399 INFO:teuthology.orchestra.run.smithi116.stderr:Modular dependency problems: 2024-01-23T07:31:33.399 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:31:33.399 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 1: conflicting requests 2024-01-23T07:31:33.399 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240105104119:20125149.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.399 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 2: conflicting requests 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 3: conflicting requests 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 4: conflicting requests 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 5: conflicting requests 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820231031173453:b754926a.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 6: conflicting requests 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820230817140043:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 7: conflicting requests 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 8: conflicting requests 2024-01-23T07:31:33.400 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 9: conflicting requests 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 10: conflicting requests 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240105093033:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 11: conflicting requests 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 12: conflicting requests 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 13: conflicting requests 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 14: conflicting requests 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.401 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 15: conflicting requests 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 16: conflicting requests 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 17: conflicting requests 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 18: conflicting requests 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 19: conflicting requests 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 20: conflicting requests 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.402 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 21: conflicting requests 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 22: conflicting requests 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 23: conflicting requests 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820231201124232:182f7c73.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 24: conflicting requests 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 25: conflicting requests 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 26: conflicting requests 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240117165712:17377f89.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 27: conflicting requests 2024-01-23T07:31:33.403 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 28: conflicting requests 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 29: conflicting requests 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 30: conflicting requests 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240108205145:b09eea91.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 31: conflicting requests 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 32: conflicting requests 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module squid:4:820230817231530:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.404 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 33: conflicting requests 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 34: conflicting requests 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 35: conflicting requests 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 36: conflicting requests 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240117192000:9edba152.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 37: conflicting requests 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 38: cannot install the best candidate for the job 2024-01-23T07:31:33.405 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 39: conflicting requests 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 40: cannot install the best candidate for the job 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.406 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 41: cannot install the best candidate for the job 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 42: cannot install the best candidate for the job 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.407 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 43: cannot install the best candidate for the job 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 44: cannot install the best candidate for the job 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: Problem 45: cannot install the best candidate for the job 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.408 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.409 INFO:teuthology.orchestra.run.smithi116.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-01-23T07:31:33.467 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2024-01-23T07:31:33.467 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-779.g1d156303.el9 ceph 1.3 M 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 1.3 M 2024-01-23T07:31:33.468 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 5.5 M 2024-01-23T07:31:33.469 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2024-01-23T07:31:33.987 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-nbd-debuginfo-19.0.0-779.g1d156303.el9.x86_ 2.4 MB/s | 1.3 MB 00:00 2024-01-23T07:31:33.988 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2024-01-23T07:31:33.988 INFO:teuthology.orchestra.run.smithi116.stdout:Total 2.4 MB/s | 1.3 MB 00:00 2024-01-23T07:31:33.989 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2024-01-23T07:31:33.992 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2024-01-23T07:31:33.992 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2024-01-23T07:31:34.033 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2024-01-23T07:31:34.034 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2024-01-23T07:31:34.267 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2024-01-23T07:31:34.387 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:31:34.861 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:31:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 1/1 2024-01-23T07:31:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:35.182 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2024-01-23T07:31:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-debuginfo-2:19.0.0-779.g1d156303.el9.x86_64 2024-01-23T07:31:35.182 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:35.182 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2024-01-23T07:31:35.396 DEBUG:teuthology.parallel:result is None 2024-01-23T07:31:35.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d1563036928048a487b8d17bdf66baca01c75bf 2024-01-23T07:31:35.620 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-23T07:31:35.641 INFO:teuthology.orchestra.run.smithi116.stdout:19.0.0-779.g1d156303.el9 2024-01-23T07:31:35.641 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-779.g1d156303.el9 2024-01-23T07:31:35.641 INFO:teuthology.task.install:The correct ceph version 19.0.0-779.g1d156303 is installed. 2024-01-23T07:31:35.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1d1563036928048a487b8d17bdf66baca01c75bf 2024-01-23T07:31:35.786 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-23T07:31:35.811 INFO:teuthology.orchestra.run.smithi173.stdout:19.0.0-779.g1d156303.el9 2024-01-23T07:31:35.811 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-779.g1d156303.el9 2024-01-23T07:31:35.811 INFO:teuthology.task.install:The correct ceph version 19.0.0-779.g1d156303 is installed. 2024-01-23T07:31:35.813 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-23T07:31:35.813 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:35.814 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-23T07:31:35.841 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:31:35.841 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-23T07:31:35.881 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-23T07:31:35.882 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:35.882 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2024-01-23T07:31:35.908 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-23T07:31:35.976 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:31:35.976 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-01-23T07:31:36.005 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-23T07:31:36.074 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-23T07:31:36.074 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:36.074 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-23T07:31:36.101 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-23T07:31:36.168 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:31:36.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-23T07:31:36.196 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-23T07:31:36.263 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-23T07:31:36.263 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:36.263 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2024-01-23T07:31:36.290 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-23T07:31:36.356 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:31:36.356 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-01-23T07:31:36.384 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-23T07:31:36.450 INFO:teuthology.run_tasks:Running task ceph... 2024-01-23T07:31:36.546 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-23T07:31:36.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2024-01-23T07:31:36.549 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2024-01-23T07:31:36.575 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-23T07:31:36.575 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-23T07:31:36.616 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-23T07:31:36.643 INFO:tasks.ceph:Creating extra log directories... 2024-01-23T07:31:36.643 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-23T07:31:36.683 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-23T07:31:36.720 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-23T07:31:36.720 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-23T07:31:36.721 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433', 'branch': 'wip-yuri7-testing-2024-01-18-1327', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7527433', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri7-testing-2024-01-18-1327'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri7-testing-2024-01-18-1327', 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf'}}, 'owner': 'scheduled_lflores@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 994, 'sha1': '1d1563036928048a487b8d17bdf66baca01c75bf', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri7-testing-2024-01-18-1327', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1d1563036928048a487b8d17bdf66baca01c75bf', 'targets': {'smithi116.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9TEWxN1NGcMkFCTgCvj3qTbkRXD6fdhbu7qOmOtqmb3+jCmrHEDFlitH/mip68KBt3XQtS0M5RDAV6xyi5Mbk=', 'smithi173.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKm7cizsa8IsSxtJo3rYn0ZL1q4EpDm5/ATvaXoFsqnwlW5KKmqctKYU6EIxoIq83QCTCMz8oKx+93C4cJmu0w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'c856e0f9244dd29a50697123b480d63f16a4ed81', 'timestamp': '2024-01-22_23:24:57', 'tube': 'smithi', 'user': 'lflores', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-23T07:31:36.721 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-23T07:31:36.750 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-23T07:31:36.765 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2024-01-23T07:31:36.804 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2024-01-23T07:31:36.832 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:36.832 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2024-01-23T07:31:36.884 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-23T07:31:36.884 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2024-01-23T07:31:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-23T07:31:36.939 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:36.939 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-01-23T07:31:36.939 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:36.940 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:36.940 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-01-23 07:21:12.844220578 +0000 2024-01-23T07:31:36.940 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-01-23 07:02:48.536355823 +0000 2024-01-23T07:31:36.940 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-01-23 07:02:48.536355823 +0000 2024-01-23T07:31:36.940 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-01-23 07:02:48.536355823 +0000 2024-01-23T07:31:36.940 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-23T07:31:37.005 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-01-23T07:31:37.005 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-01-23T07:31:37.005 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000207804 s, 2.5 MB/s 2024-01-23T07:31:37.006 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-23T07:31:37.061 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-01-23 07:21:12.844220578 +0000 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-01-23 07:02:48.892350029 +0000 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-01-23 07:02:48.892350029 +0000 2024-01-23T07:31:37.117 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-01-23 07:02:48.892350029 +0000 2024-01-23T07:31:37.117 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-23T07:31:37.182 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-01-23T07:31:37.182 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-01-23T07:31:37.182 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000195681 s, 2.6 MB/s 2024-01-23T07:31:37.184 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-23T07:31:37.239 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-01-23 07:21:12.844220578 +0000 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-01-23 07:02:49.250344204 +0000 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-01-23 07:02:49.250344204 +0000 2024-01-23T07:31:37.294 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-01-23 07:02:49.250344204 +0000 2024-01-23T07:31:37.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-23T07:31:37.359 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-01-23T07:31:37.359 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-01-23T07:31:37.359 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000208544 s, 2.5 MB/s 2024-01-23T07:31:37.360 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-23T07:31:37.416 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2024-01-23 07:21:12.845220562 +0000 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2024-01-23 07:02:49.597338558 +0000 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2024-01-23 07:02:49.597338558 +0000 2024-01-23T07:31:37.472 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: 2024-01-23 07:02:49.597338558 +0000 2024-01-23T07:31:37.473 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-23T07:31:37.545 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2024-01-23T07:31:37.545 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2024-01-23T07:31:37.545 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000173387 s, 3.0 MB/s 2024-01-23T07:31:37.547 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-23T07:31:37.615 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:37.615 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:31:37.615 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-01-23T07:31:37.634 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-23T07:31:37.634 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-01-23T07:31:37.702 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-23T07:31:37.702 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-01-23T07:31:37.702 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-01-23 07:18:59.342122210 +0000 2024-01-23T07:31:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-01-23 07:11:18.094808876 +0000 2024-01-23T07:31:37.703 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-01-23 07:11:18.094808876 +0000 2024-01-23T07:31:37.703 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-01-23 07:11:18.094808876 +0000 2024-01-23T07:31:37.703 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-23T07:31:37.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-01-23T07:31:37.778 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-01-23T07:31:37.778 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00032059 s, 1.6 MB/s 2024-01-23T07:31:37.780 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-23T07:31:37.842 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-01-23T07:31:37.909 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-01-23 07:18:59.343122187 +0000 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-01-23 07:11:18.446800737 +0000 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-01-23 07:11:18.446800737 +0000 2024-01-23T07:31:37.910 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-01-23 07:11:18.446800737 +0000 2024-01-23T07:31:37.910 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-23T07:31:37.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-01-23T07:31:37.982 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-01-23T07:31:37.982 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000199627 s, 2.6 MB/s 2024-01-23T07:31:37.983 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-23T07:31:38.047 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-01-23T07:31:38.106 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-01-23 07:18:59.343122187 +0000 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-01-23 07:11:18.776793106 +0000 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-01-23 07:11:18.776793106 +0000 2024-01-23T07:31:38.107 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-01-23 07:11:18.776793106 +0000 2024-01-23T07:31:38.107 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-23T07:31:38.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-01-23T07:31:38.174 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-01-23T07:31:38.174 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000165273 s, 3.1 MB/s 2024-01-23T07:31:38.175 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-23T07:31:38.233 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-01-23 07:18:59.343122187 +0000 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-01-23 07:11:19.114785290 +0000 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-01-23 07:11:19.114785290 +0000 2024-01-23T07:31:38.289 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-01-23 07:11:19.114785290 +0000 2024-01-23T07:31:38.289 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-23T07:31:38.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-01-23T07:31:38.355 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-01-23T07:31:38.355 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000227884 s, 2.2 MB/s 2024-01-23T07:31:38.356 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-23T07:31:38.413 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:38.413 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-23T07:31:38.413 INFO:tasks.ceph:Generating config... 2024-01-23T07:31:38.414 INFO:tasks.ceph:[client] debug monc = 20 2024-01-23T07:31:38.414 INFO:tasks.ceph:[client] debug ms = 1 2024-01-23T07:31:38.414 INFO:tasks.ceph:[client] debug objecter = 20 2024-01-23T07:31:38.414 INFO:tasks.ceph:[client] debug rados = 20 2024-01-23T07:31:38.414 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-01-23T07:31:38.414 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-01-23T07:31:38.414 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-01-23T07:31:38.415 INFO:tasks.ceph:[global] ms type = async 2024-01-23T07:31:38.415 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-01-23T07:31:38.415 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] debug bluefs = 1 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] debug bluestore = 1 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] debug monc = 20 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-23T07:31:38.416 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd class default list = * 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd class load list = * 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd client watch timeout = 120 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-01-23T07:31:38.417 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-01-23T07:31:38.418 INFO:tasks.ceph:Setting up mon.a... 2024-01-23T07:31:38.418 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-23T07:31:38.475 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.keyring 2024-01-23T07:31:38.478 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-23T07:31:38.523 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-23T07:31:38.553 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.116'), ('mon.c', '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]'), ('mon.b', '172.21.15.173')] 2024-01-23T07:31:38.554 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.173', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 120, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-01-23T07:31:38.555 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:38.555 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-23T07:31:38.609 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.116 --addv c '[v2:172.21.15.116:3301,v1:172.21.15.116:6790]' --add b 172.21.15.173 --print /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:38.693 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:38.693 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: generated fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:setting min_mon_release = quincy 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:epoch 0 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:min_mon_release 17 (quincy) 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:election_strategy: 1 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:31:38.694 INFO:teuthology.orchestra.run.smithi116.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-23T07:31:38.695 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-23T07:31:38.710 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6d11e51e-733b-4e2c-8640-454d4ffd488c... 2024-01-23T07:31:38.711 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-23T07:31:38.752 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-23T07:31:38.800 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2024-01-23T07:31:38.800 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2024-01-23T07:31:38.800 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.801 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2024-01-23T07:31:38.802 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2024-01-23T07:31:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2024-01-23T07:31:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2024-01-23T07:31:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2024-01-23T07:31:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-23T07:31:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-23T07:31:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2024-01-23T07:31:38.803 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.173" 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: mon client directed command retry = 5 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: mon election default strategy = 1 2024-01-23T07:31:38.804 INFO:teuthology.orchestra.run.smithi116.stdout: ms inject socket failures = 5000 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: ms type = async 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: osd heartbeat grace = 80 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock profile = high_recovery_ops 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2024-01-23T07:31:38.805 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug trim objects = true 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.806 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = bitmap 2024-01-23T07:31:38.807 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2024-01-23T07:31:38.808 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2024-01-23T07:31:38.808 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore zero block detection = True 2024-01-23T07:31:38.808 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 1 2024-01-23T07:31:38.808 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 1 2024-01-23T07:31:38.808 INFO:teuthology.orchestra.run.smithi116.stdout: debug monc = 20 2024-01-23T07:31:38.808 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-01-23T07:31:38.808 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 10 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd class default list = * 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd class load list = * 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd client watch timeout = 120 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify cached snaps = True 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify missing on start = True 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd fast shutdown = False 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock override recovery settings = True 2024-01-23T07:31:38.809 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: osd op queue = debug_random 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: osd op queue cut off = debug_random 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: osd shutdown pgref assert = True 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.810 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2024-01-23T07:31:38.811 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: mon min osdmap epochs = 50 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd crush smoke test = False 2024-01-23T07:31:38.812 INFO:teuthology.orchestra.run.smithi116.stdout: mon osdmap full prune interval = 2 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: mon osdmap full prune min = 15 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: mon osdmap full prune txsize = 2 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: mon scrub interval = 300 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on pool no app = False 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: paxos service trim min = 10 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: debug monc = 20 2024-01-23T07:31:38.813 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2024-01-23T07:31:38.814 INFO:teuthology.orchestra.run.smithi116.stdout: debug objecter = 20 2024-01-23T07:31:38.814 INFO:teuthology.orchestra.run.smithi116.stdout: debug rados = 20 2024-01-23T07:31:38.814 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2024-01-23T07:31:38.814 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.c] 2024-01-23T07:31:38.814 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.b] 2024-01-23T07:31:38.814 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2024-01-23T07:31:38.815 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2024-01-23T07:31:38.816 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.817 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2024-01-23T07:31:38.818 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2024-01-23T07:31:38.818 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2024-01-23T07:31:38.818 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.116,[v2:172.21.15.116:3301,v1:172.21.15.116:6790],172.21.15.173" 2024-01-23T07:31:38.818 INFO:teuthology.orchestra.run.smithi173.stdout: mon client directed command retry = 5 2024-01-23T07:31:38.818 INFO:teuthology.orchestra.run.smithi173.stdout: mon election default strategy = 1 2024-01-23T07:31:38.818 INFO:teuthology.orchestra.run.smithi173.stdout: ms inject socket failures = 5000 2024-01-23T07:31:38.818 INFO:teuthology.orchestra.run.smithi173.stdout: ms type = async 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd heartbeat grace = 80 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.819 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug trim objects = true 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2024-01-23T07:31:38.820 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: bdev async discard = True 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: bdev enable discard = True 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore allocator = bitmap 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore zero block detection = True 2024-01-23T07:31:38.821 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 1 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 1 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: debug monc = 20 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2024-01-23T07:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd class default list = * 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd class load list = * 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd client watch timeout = 120 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify cached snaps = True 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify missing on start = True 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd fast shutdown = False 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock override recovery settings = True 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue = debug_random 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue cut off = debug_random 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: osd shutdown pgref assert = True 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.823 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2024-01-23T07:31:38.824 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-01-23T07:31:38.825 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2024-01-23T07:31:38.825 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2024-01-23T07:31:38.825 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2024-01-23T07:31:38.826 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon min osdmap epochs = 50 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd crush smoke test = False 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon osdmap full prune interval = 2 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon osdmap full prune min = 15 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon osdmap full prune txsize = 2 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon scrub interval = 300 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on pool no app = False 2024-01-23T07:31:38.827 INFO:teuthology.orchestra.run.smithi173.stdout: paxos service trim min = 10 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: debug monc = 20 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: debug objecter = 20 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout: debug rados = 20 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2024-01-23T07:31:38.828 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2024-01-23T07:31:38.830 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-23T07:31:38.830 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-23T07:31:38.925 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-23T07:31:38.925 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:38.925 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-23T07:31:38.940 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:38.940 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-23T07:31:38.994 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T07:31:38.995 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:38.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-23T07:31:38.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-23T07:31:39.074 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:31:39.074 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:39.128 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T07:31:39.129 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:31:39.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-23T07:31:39.129 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-23T07:31:39.169 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:31:39.169 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:39.225 INFO:tasks.ceph:Setting up mon nodes... 2024-01-23T07:31:39.225 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-23T07:31:39.225 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-23T07:31:39.279 INFO:teuthology.orchestra.run.smithi116.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-23T07:31:39.282 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-23T07:31:39.345 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-23T07:31:39.348 INFO:tasks.ceph:Setting up mds nodes... 2024-01-23T07:31:39.348 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-23T07:31:39.348 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-23T07:31:39.390 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-23T07:31:39.406 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-23T07:31:39.447 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-23T07:31:39.462 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-23T07:31:39.463 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-23T07:31:39.463 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-23T07:31:39.489 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:39.489 INFO:tasks.ceph:role: osd.0 2024-01-23T07:31:39.490 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T07:31:39.490 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:39.564 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:40.071 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-01-23T07:31:40.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-01-23T07:31:40.073 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-23T07:31:40.210 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-23T07:31:40.245 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-23T07:31:40.313 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:40.313 INFO:tasks.ceph:role: osd.1 2024-01-23T07:31:40.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T07:31:40.314 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:40.388 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:40.844 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-01-23T07:31:40.845 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-01-23T07:31:40.846 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-23T07:31:40.933 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-23T07:31:40.963 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-23T07:31:41.031 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:41.031 INFO:tasks.ceph:role: osd.2 2024-01-23T07:31:41.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T07:31:41.031 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:41.105 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:41.587 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-01-23T07:31:41.589 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-01-23T07:31:41.589 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-23T07:31:41.745 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-23T07:31:41.777 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-23T07:31:41.844 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:41.844 INFO:tasks.ceph:role: osd.3 2024-01-23T07:31:41.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T07:31:41.844 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:41.918 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:41.919 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:41.919 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:42.415 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2024-01-23T07:31:42.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2024-01-23T07:31:42.417 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-23T07:31:42.561 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-23T07:31:42.597 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:42.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:42.693+0000 7fb8b122a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-23T07:31:42.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:42.693+0000 7fb8b122a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-23T07:31:42.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:42.693+0000 7fb8b122a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-23T07:31:42.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:42.693+0000 7fb8b122a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-23T07:31:42.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:42.694+0000 7fb8b122a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-23T07:31:42.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:42.695+0000 7fb8b122a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-23T07:31:45.539 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-23T07:31:45.570 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:45.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:45.660+0000 7f29a9a12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-23T07:31:45.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:45.660+0000 7f29a9a12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-23T07:31:45.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:45.660+0000 7f29a9a12640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-23T07:31:45.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:45.660+0000 7f29a9a12640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-23T07:31:45.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:45.660+0000 7f29a9a12640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-23T07:31:45.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:45.661+0000 7f29a9a12640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-23T07:31:48.500 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-23T07:31:48.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:48.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:48.621+0000 7fdaf5619640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-23T07:31:48.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:48.622+0000 7fdaf5619640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-23T07:31:48.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:48.622+0000 7fdaf5619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-23T07:31:48.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:48.622+0000 7fdaf5619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-23T07:31:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:48.622+0000 7fdaf5619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-23T07:31:48.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:48.622+0000 7fdaf5619640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-23T07:31:51.464 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-23T07:31:51.495 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:51.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:51.591+0000 7fb37671f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-23T07:31:51.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:51.592+0000 7fb37671f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-23T07:31:51.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:51.592+0000 7fb37671f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-23T07:31:51.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:51.592+0000 7fb37671f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-23T07:31:51.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:51.592+0000 7fb37671f640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-23T07:31:51.593 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:31:51.592+0000 7fb37671f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-23T07:31:54.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-23T07:31:54.457 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-23T07:31:54.489 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:54.489 INFO:tasks.ceph:role: osd.4 2024-01-23T07:31:54.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T07:31:54.489 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-23T07:31:54.568 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:54.568 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:54.568 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:54.569 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:54.569 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:54.569 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:54.569 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:54.569 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:54.569 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:54.569 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:55.077 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-01-23T07:31:55.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-01-23T07:31:55.079 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-23T07:31:55.207 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-23T07:31:55.243 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-23T07:31:55.313 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:55.313 INFO:tasks.ceph:role: osd.5 2024-01-23T07:31:55.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T07:31:55.313 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-23T07:31:55.388 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:55.388 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:55.388 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:55.388 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:55.389 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:55.389 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:55.389 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:55.389 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:55.389 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:55.389 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:55.832 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-01-23T07:31:55.834 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-01-23T07:31:55.834 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-23T07:31:55.917 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-23T07:31:55.988 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-23T07:31:56.055 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:56.055 INFO:tasks.ceph:role: osd.6 2024-01-23T07:31:56.055 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T07:31:56.056 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-23T07:31:56.130 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:56.131 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:56.614 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-01-23T07:31:56.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-01-23T07:31:56.616 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-23T07:31:56.750 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-23T07:31:56.783 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-23T07:31:56.850 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-23T07:31:56.850 INFO:tasks.ceph:role: osd.7 2024-01-23T07:31:56.850 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T07:31:56.850 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-23T07:31:56.924 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-23T07:31:57.451 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2024-01-23T07:31:57.455 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2024-01-23T07:31:57.455 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-23T07:31:57.596 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-23T07:31:57.630 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:31:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:31:57.731+0000 7f575bd1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-23T07:31:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:31:57.732+0000 7f575bd1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-23T07:31:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:31:57.732+0000 7f575bd1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-23T07:31:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:31:57.732+0000 7f575bd1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-23T07:31:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:31:57.732+0000 7f575bd1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-23T07:31:57.732 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:31:57.732+0000 7f575bd1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-23T07:32:00.584 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-23T07:32:00.615 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:32:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:00.707+0000 7f40da40f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-23T07:32:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:00.707+0000 7f40da40f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-23T07:32:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:00.707+0000 7f40da40f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-23T07:32:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:00.707+0000 7f40da40f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-23T07:32:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:00.707+0000 7f40da40f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-23T07:32:00.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:00.708+0000 7f40da40f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-23T07:32:03.552 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-23T07:32:03.588 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:32:03.679 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:03.679+0000 7f34c2538640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-23T07:32:03.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:03.679+0000 7f34c2538640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-23T07:32:03.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:03.679+0000 7f34c2538640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-23T07:32:03.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:03.679+0000 7f34c2538640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-23T07:32:03.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:03.679+0000 7f34c2538640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-23T07:32:03.680 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:03.680+0000 7f34c2538640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-23T07:32:06.530 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-23T07:32:06.562 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:32:06.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:06.654+0000 7ff54dbf8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-23T07:32:06.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:06.655+0000 7ff54dbf8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-23T07:32:06.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:06.655+0000 7ff54dbf8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-23T07:32:06.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:06.655+0000 7ff54dbf8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-23T07:32:06.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:06.655+0000 7ff54dbf8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-23T07:32:06.657 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:06.655+0000 7ff54dbf8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-23T07:32:09.507 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-23T07:32:09.540 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-23T07:32:09.540 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:09.540 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-23T07:32:09.572 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:09.572 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-23T07:32:09.642 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:09.642 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-23T07:32:09.711 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:09.712 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-23T07:32:09.781 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:09.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-23T07:32:09.850 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:09.850 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-23T07:32:09.881 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:09.881 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-23T07:32:09.950 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:09.950 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-23T07:32:10.019 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:10.020 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-23T07:32:10.088 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:10.088 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-23T07:32:10.156 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:10.156 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-23T07:32:10.172 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:10.173 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-23T07:32:10.211 INFO:tasks.ceph:Adding keys to all mons... 2024-01-23T07:32:10.212 DEBUG:teuthology.orchestra.run.smithi116:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-23T07:32:10.216 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-23T07:32:10.256 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.y] 2024-01-23T07:32:10.256 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBba69lI5O8EBAASkEsIJG3w1f1X3N+zyPZyw== 2024-01-23T07:32:10.256 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.0] 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBea69lwrlpKRAAvFCT8gF28fkwIVjgHtrf4Q== 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.1] 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBha69lQltxJxAAIZIzwRv8IKn3g2mXNmNCVQ== 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.2] 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBka69lxYghJRAA6QFrIWoB+0A7iEBcL2ywpQ== 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.3] 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBna69lMVJZIxAAUBqOcQq5e2nS3dGImqEu4Q== 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr.x] 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBba69lI3akFBAAbubk8V9fuvX0m3L7uwMMkw== 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.4] 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBta69lESytKxAAjliSjx0cAKDsqy+vimr1nA== 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.5] 2024-01-23T07:32:10.257 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBwa69lX940KhAAU6il/i1jiDt7MXIjZ79p2Q== 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.6] 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBza69lERqOKBAAYFYmT0WKdi6FdekdAMz21A== 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout:[osd.7] 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQB2a69lW/0lJxAA6EgVZLG9Ou3ZlN1gWmsb1A== 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout:[client.0] 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBba69lBWpXFxAALsMFU0Wo735dgfw3QbiGug== 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout:[client.1] 2024-01-23T07:32:10.258 INFO:teuthology.orchestra.run.smithi116.stdout: key = AQBba69l2O2/GhAAnOJ38dSMbXXbu7ChhtNPoQ== 2024-01-23T07:32:10.278 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2024-01-23T07:32:10.278 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBba69lI5O8EBAASkEsIJG3w1f1X3N+zyPZyw== 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBea69lwrlpKRAAvFCT8gF28fkwIVjgHtrf4Q== 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBha69lQltxJxAAIZIzwRv8IKn3g2mXNmNCVQ== 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBka69lxYghJRAA6QFrIWoB+0A7iEBcL2ywpQ== 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBna69lMVJZIxAAUBqOcQq5e2nS3dGImqEu4Q== 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBba69lI3akFBAAbubk8V9fuvX0m3L7uwMMkw== 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBta69lESytKxAAjliSjx0cAKDsqy+vimr1nA== 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2024-01-23T07:32:10.279 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBwa69lX940KhAAU6il/i1jiDt7MXIjZ79p2Q== 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBza69lERqOKBAAYFYmT0WKdi6FdekdAMz21A== 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQB2a69lW/0lJxAA6EgVZLG9Ou3ZlN1gWmsb1A== 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBba69lBWpXFxAALsMFU0Wo735dgfw3QbiGug== 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2024-01-23T07:32:10.280 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQBba69l2O2/GhAAnOJ38dSMbXXbu7ChhtNPoQ== 2024-01-23T07:32:10.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T07:32:10.301 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T07:32:10.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.375 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.426 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.428 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.480 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.482 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.533 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.586 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T07:32:10.588 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-23T07:32:10.639 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.641 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.692 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.694 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.747 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.749 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.803 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-23T07:32:10.854 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-23T07:32:10.857 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-23T07:32:10.911 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-23T07:32:10.914 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-23T07:32:10.968 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-23T07:32:10.968 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-23T07:32:10.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-23T07:32:11.091 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-23T07:32:11.118 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-23T07:32:11.184 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-23T07:32:11.281 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-23T07:32:11.308 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-23T07:32:11.335 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-23T07:32:11.433 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-23T07:32:11.459 DEBUG:teuthology.orchestra.run.smithi116:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:32:11.461 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-23T07:32:11.514 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-23T07:32:11.514 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-23T07:32:11.515 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-23T07:32:11.515 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-01-23T07:32:11.517 INFO:tasks.ceph.mon.a:Started 2024-01-23T07:32:11.517 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-23T07:32:11.517 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-23T07:32:11.517 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-01-23T07:32:11.519 INFO:tasks.ceph.mon.c:Started 2024-01-23T07:32:11.519 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-01-23T07:32:11.519 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-23T07:32:11.520 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-01-23T07:32:11.556 INFO:tasks.ceph.mon.b:Started 2024-01-23T07:32:11.556 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-23T07:32:11.557 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-23T07:32:11.557 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-01-23T07:32:11.559 INFO:tasks.ceph.mgr.y:Started 2024-01-23T07:32:11.559 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-23T07:32:11.559 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-01-23T07:32:11.561 INFO:tasks.ceph.mgr.x:Started 2024-01-23T07:32:11.561 INFO:tasks.ceph:Setting crush tunables to default 2024-01-23T07:32:11.561 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd crush tunables default 2024-01-23T07:32:11.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.683+0000 7f52eb7a7640 10 monclient: get_monmap_and_config 2024-01-23T07:32:11.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.683+0000 7f52eb7a7640 10 monclient: build_initial_monmap 2024-01-23T07:32:11.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.683+0000 7f52eb7a7640 10 monclient: monmap: 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:32:11.684487+0000 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:32:11.684487+0000 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:11.684 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:11.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.683+0000 7f52eb7a7640 1 Processor -- start 2024-01-23T07:32:11.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 1 -- start start 2024-01-23T07:32:11.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient: init 2024-01-23T07:32:11.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:11.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient: _add_conns ranks=[0,3,2,1,4] 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f52e40aaf90 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 0x7f52e40acee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient(hunting): picked mon.noname-a con 0x7f52e40a9ed0 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 0x7f52e40ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient(hunting): picked mon.noname-b con 0x7f52e40ab370 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e40aa3f0 con 0x7f52e40aaf90 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40ac400 con 0x7f52e40a9ed0 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40ac6e0 con 0x7f52e40ab370 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52eb7a7640 10 monclient(hunting): authenticate will time out at 2339.042905s 2024-01-23T07:32:11.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52e9543640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52e40aaf90 legacy=0x7f52e413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:11.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52e8d42640 1 -- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 msgr2=0x7f52e40acee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3300/0 2024-01-23T07:32:11.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52e9d44640 1 -- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 msgr2=0x7f52e40ad420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3301/0 2024-01-23T07:32:11.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52e8d42640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 0x7f52e40acee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:11.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.684+0000 7f52e9d44640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 0x7f52e40ad420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.885+0000 7f52e9543640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52e40aaf90 legacy=0x7f52e413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.885+0000 7f52e8d42640 1 -- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 msgr2=0x7f52e40acee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3300/0 2024-01-23T07:32:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.885+0000 7f52e9d44640 1 -- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 msgr2=0x7f52e40ad420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3301/0 2024-01-23T07:32:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.885+0000 7f52e9d44640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 0x7f52e40ad420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:11.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:11.885+0000 7f52e8d42640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 0x7f52e40acee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:12.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:12.286+0000 7f52e9543640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52e40aaf90 legacy=0x7f52e413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:12.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:12.286+0000 7f52e9d44640 1 -- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 msgr2=0x7f52e40ad420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3301/0 2024-01-23T07:32:12.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:12.286+0000 7f52e8d42640 1 -- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 msgr2=0x7f52e40acee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3300/0 2024-01-23T07:32:12.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:12.286+0000 7f52e9d44640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 0x7f52e40ad420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:12.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:12.286+0000 7f52e8d42640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 0x7f52e40acee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:13.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:13.087+0000 7f52e9d44640 1 -- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 msgr2=0x7f52e40ad420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3301/0 2024-01-23T07:32:13.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:13.087+0000 7f52e9543640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52e40aaf90 legacy=0x7f52e413b600 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:13.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:13.087+0000 7f52e8d42640 1 -- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 msgr2=0x7f52e40acee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.116:3300/0 2024-01-23T07:32:13.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:13.087+0000 7f52e9d44640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 0x7f52e40ad420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:13.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:13.087+0000 7f52e8d42640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 0x7f52e40acee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:14.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient(hunting): tick 2024-01-23T07:32:14.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient(hunting): _check_auth_tickets 2024-01-23T07:32:14.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 monclient(hunting): continuing hunt 2024-01-23T07:32:14.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient(hunting): _reopen_session rank -1 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 -- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 msgr2=0x7f52e40ad420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52e40ab370 0x7f52e40ad420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 -- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 msgr2=0x7f52e40acee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52e40a9ed0 0x7f52e40acee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52e40aaf90 legacy=0x7f52e413b600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient: _add_conns ranks=[4,1] 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 0x7f52c8005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-c con 0x7f52c80036c0 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f52c8006190 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e413bd10 con 0x7f52c8006190 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40ac400 con 0x7f52c80036c0 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52daffd640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:14.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52e9543640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 msgr2=0x7f52c8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:14.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52e8d42640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8006190 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:14.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.684+0000 7f52e9543640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 0x7f52c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:14.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.885+0000 7f52e8d42640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8006190 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:14.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.885+0000 7f52e9543640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 msgr2=0x7f52c8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:14.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:14.885+0000 7f52e9543640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 0x7f52c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:15.286+0000 7f52e9543640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 msgr2=0x7f52c8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:15.286+0000 7f52e8d42640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8006190 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:15.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:15.286+0000 7f52e9543640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 0x7f52c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:16.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:16.087+0000 7f52e9543640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 msgr2=0x7f52c8005b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:16.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:16.087+0000 7f52e9543640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 0x7f52c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:16.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:16.087+0000 7f52e8d42640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8006190 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.684+0000 7f52daffd640 10 monclient(hunting): tick 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.684+0000 7f52daffd640 10 monclient(hunting): _check_auth_tickets 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.684+0000 7f52daffd640 1 monclient(hunting): continuing hunt 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.684+0000 7f52daffd640 10 monclient(hunting): _reopen_session rank -1 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.684+0000 7f52daffd640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 msgr2=0x7f52c8005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.684+0000 7f52daffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c80036c0 0x7f52c8005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.684+0000 7f52daffd640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8006190 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52e9d44640 1 -- reap_dead start 2024-01-23T07:32:17.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f52c8008d80 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f52c8005be0 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 0x7f52c8010280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-c con 0x7f52c8009960 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e40aa3f0 con 0x7f52c8005be0 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e413bd10 con 0x7f52c8008d80 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40ac400 con 0x7f52c8009960 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52daffd640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52e8d42640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52c8005be0 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52e9d44640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 msgr2=0x7f52c8010280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52e9543640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8008d80 legacy=0x7f52c8009160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:17.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.685+0000 7f52e9d44640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 0x7f52c8010280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.886+0000 7f52e8d42640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52c8005be0 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.886+0000 7f52e9d44640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 msgr2=0x7f52c8010280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.886+0000 7f52e9543640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8008d80 legacy=0x7f52c8009160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:17.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:17.886+0000 7f52e9d44640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 0x7f52c8010280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:18.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:18.287+0000 7f52e8d42640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52c8005be0 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:18.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:18.287+0000 7f52e9d44640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 msgr2=0x7f52c8010280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:18.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:18.287+0000 7f52e9d44640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 0x7f52c8010280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:18.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:18.287+0000 7f52e9543640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8008d80 legacy=0x7f52c8009160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:18.469 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:00:06.805 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:32:18.651 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:00:07.030 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:32:18.652 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:00:07.032 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:32:18.777 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:00:07.113 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:32:18.972 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:00:07.352 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:32:18.973 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:00:07.352 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:32:19.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:19.088+0000 7f52e8d42640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52c8005be0 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.116:6789/0 2024-01-23T07:32:19.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:19.088+0000 7f52e9d44640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 msgr2=0x7f52c8010280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.173:3300/0 2024-01-23T07:32:19.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:19.088+0000 7f52e9543640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8008d80 legacy=0x7f52c8009160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.173:6789/0 2024-01-23T07:32:19.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:19.088+0000 7f52e9d44640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 0x7f52c8010280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:20.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): tick 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): _check_auth_tickets 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 monclient(hunting): continuing hunt 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): _reopen_session rank -1 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 -- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 msgr2=0x7f52c8010280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f52c8009960 0x7f52c8010280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 -- >> v1:172.21.15.173:6789/0 conn(0x7f52c8008d80 legacy=0x7f52c8009160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 -- >> v1:172.21.15.116:6789/0 conn(0x7f52c8005be0 legacy=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient: _add_conns ranks=[3,2] 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-a con 0x7f52c80109f0 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:20.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-b con 0x7f52c8011470 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40ac400 con 0x7f52c80109f0 2024-01-23T07:32:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40ac6e0 con 0x7f52c8011470 2024-01-23T07:32:20.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.685+0000 7f52daffd640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:20.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.703+0000 7f52e8d42640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:20.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.703+0000 7f52e8d42640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:49712/0 (socket says 172.21.15.116:49712) 2024-01-23T07:32:20.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.703+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 learned_addr learned my addr 172.21.15.116:0/1958787462 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:20.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.703+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8011470 auth_method 0 2024-01-23T07:32:20.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.703+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:20.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.703+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:20.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.703+0000 7f52e8d42640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:20.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.704+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:20.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.704+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:20.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.704+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:20.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.704+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:20.708 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.708+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:20.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.713+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c80109f0 auth_method 0 2024-01-23T07:32:20.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.713+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:20.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.713+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:20.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.713+0000 7f52e9543640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:20.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.716+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:20.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.716+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:20.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.716+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:20.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:20.716+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:21.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.059+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:21.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.059+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8011470 auth_method 0 2024-01-23T07:32:21.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.059+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:21.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.059+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:21.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.059+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:21.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.061+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:21.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.061+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:21.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.061+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:21.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.061+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:21.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.136+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:21.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.137+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c80109f0 auth_method 0 2024-01-23T07:32:21.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.137+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:21.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.137+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:21.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.137+0000 7f52e9543640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:21.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.256+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:21.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.256+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:21.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.256+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:21.256 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.256+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:21.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.475+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:21.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.476+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8011470 auth_method 0 2024-01-23T07:32:21.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.476+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:21.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.476+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:21.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.476+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:21.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.548+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:21.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.548+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:21.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.548+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:21.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.548+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:21.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.695+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:21.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.698+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c80109f0 auth_method 0 2024-01-23T07:32:21.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.698+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:21.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.698+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:21.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.698+0000 7f52e9543640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:21.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.710+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:21.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.710+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:21.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.710+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:21.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:21.710+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:22.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.349+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:22.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.349+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8011470 auth_method 0 2024-01-23T07:32:22.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.349+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:22.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.349+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:22.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.349+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:22.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.350+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:22.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.350+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:22.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.350+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:22.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.350+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:22.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.513+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:22.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.514+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c80109f0 auth_method 0 2024-01-23T07:32:22.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.514+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:22.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.514+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:22.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.514+0000 7f52e9543640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:22.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.515+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:22.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.515+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:22.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.515+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:22.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:22.515+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:23.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): tick 2024-01-23T07:32:23.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): _check_auth_tickets 2024-01-23T07:32:23.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 monclient(hunting): continuing hunt 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): _reopen_session rank -1 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8011470 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 msgr2=0x7f52c8010e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c80109f0 0x7f52c8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52e9d44640 1 -- 172.21.15.116:0/1958787462 reap_dead start 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient: _add_conns ranks=[2,3,1,0,4] 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-b con 0x7f52c8010e00 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-a con 0x7f52c8005b40 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f52c80120b0 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c8012a80 con 0x7f52c80120b0 2024-01-23T07:32:23.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40ac400 con 0x7f52c8005b40 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40ac6e0 con 0x7f52c8010e00 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.686+0000 7f52daffd640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.687+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.687+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c8010e00 auth_method 0 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.687+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.687+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:23.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.687+0000 7f52e9543640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.688+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.688+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.688+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.688+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.689+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.689+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8005b40 auth_method 0 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.689+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.689+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:23.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.689+0000 7f52e8d42640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:23.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.690+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:23.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.690+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:23.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.690+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:23.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.690+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:23.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.889+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:23.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.889+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c8010e00 auth_method 0 2024-01-23T07:32:23.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.889+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:23.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.889+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:23.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.889+0000 7f52e9543640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:23.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.890+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:23.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.890+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:23.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.890+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:23.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.890+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:23.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.891+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:23.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.891+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8005b40 auth_method 0 2024-01-23T07:32:23.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.891+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:23.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.891+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:23.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.891+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:23.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.892+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:23.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.892+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:23.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.892+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:23.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:23.892+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:24.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.291+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:24.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c8010e00 auth_method 0 2024-01-23T07:32:24.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:24.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:24.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:24.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:24.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:24.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:24.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.292+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:24.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.293+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.293+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8005b40 auth_method 0 2024-01-23T07:32:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.293+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.293+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.293+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.294+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.294+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:24.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.294+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:24.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:24.294+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:25.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.094+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.094+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52c8010e00 auth_method 0 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.094+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.094+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.094+0000 7f52e9543640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.095+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.095+0000 7f52e9543640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.095+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.095+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.096+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:25.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.096+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8005b40 auth_method 0 2024-01-23T07:32:25.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.096+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:25.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.096+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:25.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.096+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:25.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.097+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:25.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.097+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:25.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.097+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:25.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:25.097+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:26.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient(hunting): tick 2024-01-23T07:32:26.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient(hunting): _check_auth_tickets 2024-01-23T07:32:26.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 monclient(hunting): continuing hunt 2024-01-23T07:32:26.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient(hunting): _reopen_session rank -1 2024-01-23T07:32:26.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 msgr2=0x7f52c8011a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:26.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52c8010e00 0x7f52c8011a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 msgr2=0x7f52c8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.116:3300/0 conn(0x7f52c8005b40 0x7f52c8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 >> v1:172.21.15.173:6789/0 conn(0x7f52c80120b0 legacy=0x7f52c8008d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient: _add_conns ranks=[0,4] 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f52c8009490 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient(hunting): picked mon.noname-c con 0x7f52c8012620 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e40aa3f0 con 0x7f52c8009490 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 1 -- 172.21.15.116:0/1958787462 --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e40ac400 con 0x7f52c8012620 2024-01-23T07:32:26.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.686+0000 7f52daffd640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:26.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.689+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:26.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.689+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8012620 auth_method 0 2024-01-23T07:32:26.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.689+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:26.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.689+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:26.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.689+0000 7f52e8d42640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:26.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.690+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:26.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.690+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:26.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.690+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:26.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.690+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:26.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.892+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:26.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.892+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8012620 auth_method 0 2024-01-23T07:32:26.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.892+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:26.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.892+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:26.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.892+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:26.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.893+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:26.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.893+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:26.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.893+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:26.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:26.893+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-23T07:32:27.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.294+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:27.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8012620 auth_method 0 2024-01-23T07:32:27.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:27.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:27.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:27.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:27.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:27.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:27.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:27.295+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-23T07:32:28.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.232+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:28.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.271+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52c8012620 auth_method 0 2024-01-23T07:32:28.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.271+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:28.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.271+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.271+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.302+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-01-23T07:32:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.302+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.302+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:28.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.302+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-23T07:32:28.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.537+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324742879 0 0) 0x7f52e40aa3f0 con 0x7f52c8009490 2024-01-23T07:32:28.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.537+0000 7f52dbfff640 10 monclient(hunting): _negotiate 2024-01-23T07:32:28.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.537+0000 7f52dbfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.537+0000 7f52dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:28.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.537+0000 7f52dbfff640 10 monclient(hunting): my global_id is 4098 2024-01-23T07:32:28.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.537+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d0003520 con 0x7f52c8009490 2024-01-23T07:32:28.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 673268114 0 0) 0x7f52d0003520 con 0x7f52c8009490 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 msgr2=0x7f52c800f9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 --2- 172.21.15.116:0/1958787462 >> v2:172.21.15.173:3300/0 conn(0x7f52c8012620 0x7f52c800f9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: _finish_hunting 0 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 monclient: found mon.noname-a-legacy 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.116:6789/0 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e413bd10 con 0x7f52c8009490 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: _finish_auth 0 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: _check_auth_tickets 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4041568432 0 0) 0x7f52e0009810 con 0x7f52c8009490 2024-01-23T07:32:28.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: dump: 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] but i'm connected to v1:172.21.15.116:6789/0, reconnecting 2024-01-23T07:32:28.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 >> v1:172.21.15.116:6789/0 conn(0x7f52c8009490 legacy=0x7f52c800f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52e9d44640 1 -- 172.21.15.116:0/1958787462 reap_dead start 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52d0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): picked mon.b con 0x7f52d0003970 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00047c0 0x7f52d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): picked mon.a con 0x7f52d00047c0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 0x7f52d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): picked mon.c con 0x7f52d00051d0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40ac400 con 0x7f52d00047c0 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d000c100 con 0x7f52d0003970 2024-01-23T07:32:28.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d000c2c0 con 0x7f52d00051d0 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.584+0000 7f52dbfff640 10 monclient(hunting): _finish_auth 0 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 0x7f52d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9543640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52d0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 10 monclient(hunting): get_auth_request con 0x7f52d00051d0 auth_method 0 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52d0003970 auth_method 0 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9543640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:28.589 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 msgr2=0x7f52d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-23T07:32:28.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 msgr2=0x7f52d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:28.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 0x7f52d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:28.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.585+0000 7f52e9d44640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 0x7f52d000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:28.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.593+0000 7f52e9543640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:28.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.593+0000 7f52e9543640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:28.592 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.593+0000 7f52e9543640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T07:32:28.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.617+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00047c0 0x7f52d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:28.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.619+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52d00047c0 auth_method 0 2024-01-23T07:32:28.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.619+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:28.618 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.619+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.619+0000 7f52e8d42640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:32:28.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.624+0000 7f52e8d42640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:28.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.624+0000 7f52e8d42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:28.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.624+0000 7f52e8d42640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T07:32:28.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 10 monclient(hunting): handle_auth_done global_id 4098 payload 293 2024-01-23T07:32:28.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 msgr2=0x7f52d000b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:28.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 0x7f52d000b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 msgr2=0x7f52d0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:28.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52d0003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 10 monclient: _finish_hunting 0 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 1 monclient: found mon.a 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 1 -- 172.21.15.116:0/1958787462 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0003520 con 0x7f52d00047c0 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 10 monclient: _finish_auth 0 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 10 monclient: _check_auth_tickets 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52e8d42640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52eb7a7640 5 monclient: authenticate success, global_id 4098 2024-01-23T07:32:28.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.634+0000 7f52eb7a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:28.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.641+0000 7f52e8d42640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00047c0 0x7f52d0004c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009560 tx=0x7f52d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a539ab7845b68b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:28.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d400e040 con 0x7f52d00047c0 2024-01-23T07:32:28.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:28.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:28.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 10 monclient: dump: 2024-01-23T07:32:28.650 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:28.650 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d4031050 con 0x7f52d00047c0 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52eb7a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52eb7a7640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 1 -- 172.21.15.116:0/1958787462 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4035400 con 0x7f52d00047c0 2024-01-23T07:32:28.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52eb7a7640 4 set_mon_vals no callback set 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52dbfff640 10 monclient: dump: 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:28.652 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52eb7a7640 10 monclient: shutdown 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52eb7a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52eb7a7640 1 -- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00047c0 msgr2=0x7f52d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.650+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00047c0 0x7f52d0004c40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009560 tx=0x7f52d00057f0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.651+0000 7f52eb7a7640 1 -- 172.21.15.116:0/1958787462 shutdown_connections 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.651+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00051d0 0x7f52d000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.651+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00047c0 0x7f52d0004c40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.651+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/1958787462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52d0003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.651+0000 7f52eb7a7640 1 -- 172.21.15.116:0/1958787462 >> 172.21.15.116:0/1958787462 conn(0x7f52e40b0320 msgr2=0x7f52e40b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.651+0000 7f52eb7a7640 1 -- 172.21.15.116:0/1958787462 shutdown_connections 2024-01-23T07:32:28.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.651+0000 7f52eb7a7640 1 -- 172.21.15.116:0/1958787462 wait complete. 2024-01-23T07:32:28.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 10 monclient: build_initial_monmap 2024-01-23T07:32:28.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 10 monclient: monmap: 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 librados: starting msgr at 2024-01-23T07:32:28.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 librados: starting objecter 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 Processor -- start 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 -- start start 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 librados: setting wanted keys 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 librados: calling monclient init 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 10 monclient: init 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52e4137d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 10 monclient(hunting): picked mon.noname-b con 0x7f52d0003970 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 0x7f52e40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.652+0000 7f52eb7a7640 10 monclient(hunting): picked mon.noname-c con 0x7f52d00047c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00051d0 0x7f52e4134a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 10 monclient(hunting): picked mon.noname-a con 0x7f52d00051d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:28.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4071fe0 con 0x7f52d00051d0 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4070cc0 con 0x7f52d0003970 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4070f30 con 0x7f52d00047c0 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52eb7a7640 10 monclient(hunting): authenticate will time out at 2356.010227s 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9d44640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00051d0 0x7f52e4134a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e8d42640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 0x7f52e40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9543640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52e4137d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e8d42640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 0x7f52e40716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:59982/0 (socket says 172.21.15.116:59982) 2024-01-23T07:32:28.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e8d42640 1 -- 172.21.15.116:0/100639999 learned_addr learned my addr 172.21.15.116:0/100639999 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e8d42640 10 monclient(hunting): get_auth_request con 0x7f52d00047c0 auth_method 0 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e8d42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e8d42640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e8d42640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9d44640 10 monclient(hunting): get_auth_request con 0x7f52d00051d0 auth_method 0 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9d44640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9d44640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9d44640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9543640 10 monclient(hunting): get_auth_request con 0x7f52d0003970 auth_method 0 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.653+0000 7f52e9543640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e9543640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e9543640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:28.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e8d42640 1 -- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 msgr2=0x7f52e40716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e8d42640 1 -- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 msgr2=0x7f52e40716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e8d42640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 0x7f52e40716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e8d42640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 0x7f52e40716a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e9d44640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e9d44640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.654+0000 7f52e9d44640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.655+0000 7f52e9543640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.655+0000 7f52e9543640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:28.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.655+0000 7f52e9543640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:28.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 10 monclient(hunting): handle_auth_done global_id 4101 payload 824 2024-01-23T07:32:28.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 1 -- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 msgr2=0x7f52e40716a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-23T07:32:28.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 0x7f52e40716a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 1 -- 172.21.15.116:0/100639999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 msgr2=0x7f52e4137d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:28.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52e4137d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:28.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 10 monclient: _finish_hunting 0 2024-01-23T07:32:28.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 1 monclient: found mon.noname-a 2024-01-23T07:32:28.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:28.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:28.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.665+0000 7f52e9d44640 1 -- 172.21.15.116:0/100639999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4071be0 con 0x7f52d00051d0 2024-01-23T07:32:28.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.667+0000 7f52e9d44640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00051d0 0x7f52e4134a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006100 tx=0x7f52dc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:28.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.667+0000 7f52d9ffb640 10 client.?.objecter ms_handle_connect 0x7f52d00051d0 2024-01-23T07:32:28.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.667+0000 7f52d9ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 1 -- 172.21.15.116:0/100639999 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0099b0 con 0x7f52d00051d0 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: dump: 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.671 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: _finish_auth 0 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 1 -- 172.21.15.116:0/100639999 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc009b10 con 0x7f52d00051d0 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 5 monclient: authenticate success, global_id 4101 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:28.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 10 monclient: _renew_subs 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 1 -- 172.21.15.116:0/100639999 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc009ec0 con 0x7f52d00051d0 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e4134f90 con 0x7f52d00051d0 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52db7fe640 4 set_mon_vals no callback set 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52d9ffb640 10 monclient: dump: 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:28.673 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 10 client.4101.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 10 monclient: _renew_subs 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e41d5e00 con 0x7f52d00051d0 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.671+0000 7f52eb7a7640 1 librados: init done 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.672+0000 7f52eb7a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.672+0000 7f52eb7a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.672+0000 7f52eb7a7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:28.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.672+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e4072190 con 0x7f52d00051d0 2024-01-23T07:32:28.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.687+0000 7f52d9ffb640 1 -- 172.21.15.116:0/100639999 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f52dc019460 con 0x7f52d00051d0 2024-01-23T07:32:28.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.687+0000 7f52d9ffb640 1 -- 172.21.15.116:0/100639999 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f52dc023870 con 0x7f52d00051d0 2024-01-23T07:32:28.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.687+0000 7f52d9ffb640 10 client.4101.objecter ms_dispatch 0x7f52e4000b90 osd_map(1..1 src has 1..1) v4 2024-01-23T07:32:28.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.687+0000 7f52d9ffb640 3 client.4101.objecter handle_osd_map got epochs [1,1] > 0 2024-01-23T07:32:28.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.687+0000 7f52d9ffb640 3 client.4101.objecter handle_osd_map decoding full epoch 1 2024-01-23T07:32:28.687 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.687+0000 7f52d9ffb640 20 client.4101.objecter dump_active .. 0 homeless 2024-01-23T07:32:28.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.854+0000 7f52d9ffb640 1 -- 172.21.15.116:0/100639999 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f52e4072190 con 0x7f52d00051d0 2024-01-23T07:32:28.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.854+0000 7f52d9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:28.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.854+0000 7f52d9ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.928+0000 7f52eb7a7640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-01-23T07:32:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.928+0000 7f52eb7a7640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-01-23T07:32:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.928+0000 7f52eb7a7640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:28.928 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:28.929+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f52e4071070 con 0x7f52d00051d0 2024-01-23T07:32:29.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.509+0000 7f52d9ffb640 1 -- 172.21.15.116:0/100639999 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f52e4071070 con 0x7f52d00051d0 2024-01-23T07:32:29.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.509+0000 7f52d9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-01-23T07:32:29.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.509+0000 7f52d9ffb640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-01-23T07:32:29.509 INFO:teuthology.orchestra.run.smithi116.stderr:adjusted tunables profile to default 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.510+0000 7f52eb7a7640 10 librados: watch_flush enter 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.510+0000 7f52eb7a7640 10 librados: watch_flush exit 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.510+0000 7f52eb7a7640 20 client.4101.objecter shutdown clearing up homeless session... 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.510+0000 7f52eb7a7640 10 client.4101.objecter successfully canceled tick 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 10 monclient: shutdown 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00051d0 msgr2=0x7f52e4134a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00051d0 0x7f52e4134a50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f52c8006100 tx=0x7f52dc00cc20 comp rx=0 tx=0).stop 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 shutdown_connections 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f52d00051d0 0x7f52e4134a50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f52d00047c0 0x7f52e40716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 --2- 172.21.15.116:0/100639999 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f52d0003970 0x7f52e4137d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:29.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 >> 172.21.15.116:0/100639999 conn(0x7f52e40b0320 msgr2=0x7f52e413f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:29.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 shutdown_connections 2024-01-23T07:32:29.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 -- 172.21.15.116:0/100639999 wait complete. 2024-01-23T07:32:29.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:29.511+0000 7f52eb7a7640 1 librados: shutdown 2024-01-23T07:32:29.520 INFO:tasks.ceph:check_enable_crimson: False 2024-01-23T07:32:29.521 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-23T07:32:29.521 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:29.521 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-23T07:32:29.550 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:29.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-23T07:32:29.619 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:29.619 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-23T07:32:29.688 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:32:29.688 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-23T07:32:29.757 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:29.757 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-23T07:32:29.784 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:29.785 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-23T07:32:29.853 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:29.853 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-23T07:32:29.919 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-01-23T07:32:29.919 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-23T07:32:29.986 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 605eb632-aafd-48cf-8ee1-87217823fcc5 0 2024-01-23T07:32:30.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.127+0000 7f0d02d1f640 10 monclient: get_monmap_and_config 2024-01-23T07:32:30.127 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.127+0000 7f0d02d1f640 10 monclient: build_initial_monmap 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.127+0000 7f0d02d1f640 10 monclient: monmap: 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:30.128446+0000 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:30.128446+0000 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:30.128 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 1 Processor -- start 2024-01-23T07:32:30.130 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 1 -- start start 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient: init 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient: _add_conns ranks=[0,1,4,2,3] 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0cfc0a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0cfc13faa0 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0cfc0b1850 0x7f0cfc145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient(hunting): picked mon.noname-c con 0x7f0cfc0b1850 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0aac10 con 0x7f0cfc0a96e0 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0a9ac0 con 0x7f0cfc13faa0 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc0a9e00 con 0x7f0cfc0b1850 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:30.131 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.128+0000 7f0d02d1f640 10 monclient(hunting): authenticate will time out at 2343.371931s 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.129+0000 7f0d012bc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f0cfc0b1850 0x7f0cfc145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.129+0000 7f0d00abb640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f0cfc0a96e0 0x7f0cfc13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.173:39182/0 (socket says 172.21.15.173:39182) 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.129+0000 7f0d00abb640 1 -- 172.21.15.173:0/4230162146 learned_addr learned my addr 172.21.15.173:0/4230162146 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.130+0000 7f0d012bc640 10 monclient(hunting): get_auth_request con 0x7f0cfc0b1850 auth_method 0 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.130+0000 7f0d012bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.130+0000 7f0d012bc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.130+0000 7f0d012bc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.130+0000 7f0d012bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.130+0000 7f0d012bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:30.132 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.130+0000 7f0d012bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:30.133 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.132+0000 7f0cfb7fe640 1 -- 172.21.15.173:0/4230162146 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407437507 0 0) 0x7f0cfc0aac10 con 0x7f0cfc0a96e0 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.132+0000 7f0cfb7fe640 10 monclient(hunting): _negotiate 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.132+0000 7f0cfb7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.132+0000 7f0cfb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.132+0000 7f0cfb7fe640 10 monclient(hunting): my global_id is 4116 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.132+0000 7f0cfb7fe640 1 -- 172.21.15.173:0/4230162146 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cec003520 con 0x7f0cfc0a96e0 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 10 monclient(hunting): handle_auth_done global_id 4114 payload 274 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 1 -- 172.21.15.173:0/4230162146 >> v1:172.21.15.173:6789/0 conn(0x7f0cfc13faa0 legacy=0x7f0cfc145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 1 -- 172.21.15.173:0/4230162146 >> v1:172.21.15.116:6789/0 conn(0x7f0cfc0a96e0 legacy=0x7f0cfc13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 10 monclient: _finish_hunting 0 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 1 monclient: found mon.noname-c 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.134 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.133+0000 7f0d012bc640 1 -- 172.21.15.173:0/4230162146 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0aae80 con 0x7f0cfc0b1850 2024-01-23T07:32:30.135 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.135+0000 7f0d012bc640 1 --2- 172.21.15.173:0/4230162146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc145d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009d90 tx=0x7f0cf402beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d92baaf021dae server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 1 -- 172.21.15.173:0/4230162146 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf402cc60 con 0x7f0cfc0b1850 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: dump: 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.145 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: _finish_auth 0 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 1 -- 172.21.15.173:0/4230162146 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf402cdc0 con 0x7f0cfc0b1850 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 5 monclient: authenticate success, global_id 4114 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 1 -- 172.21.15.173:0/4230162146 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4034660 con 0x7f0cfc0b1850 2024-01-23T07:32:30.146 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 4 set_mon_vals no callback set 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0cfb7fe640 10 monclient: dump: 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.147 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 10 monclient: shutdown 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 1 -- 172.21.15.173:0/4230162146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 msgr2=0x7f0cfc145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 1 --2- 172.21.15.173:0/4230162146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc145d10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0cf4009d90 tx=0x7f0cf402beb0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 1 -- 172.21.15.173:0/4230162146 shutdown_connections 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 1 --2- 172.21.15.173:0/4230162146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc145d10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.144+0000 7f0d02d1f640 1 -- 172.21.15.173:0/4230162146 >> 172.21.15.173:0/4230162146 conn(0x7f0cfc0b7bb0 msgr2=0x7f0cfc0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.145+0000 7f0d02d1f640 1 -- 172.21.15.173:0/4230162146 shutdown_connections 2024-01-23T07:32:30.148 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.145+0000 7f0d02d1f640 1 -- 172.21.15.173:0/4230162146 wait complete. 2024-01-23T07:32:30.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.145+0000 7f0d02d1f640 10 monclient: build_initial_monmap 2024-01-23T07:32:30.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.145+0000 7f0d02d1f640 10 monclient: monmap: 2024-01-23T07:32:30.153 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:30.153 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:30.153 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.145+0000 7f0d02d1f640 1 librados: starting msgr at 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.145+0000 7f0d02d1f640 1 librados: starting objecter 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 Processor -- start 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 -- start start 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 librados: setting wanted keys 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 librados: calling monclient init 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient: init 2024-01-23T07:32:30.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 0x7f0cfc0abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): picked mon.noname-c con 0x7f0cfc0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc0ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): picked mon.noname-b con 0x7f0cfc0b1850 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cfc13faa0 0x7f0cfc140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): picked mon.noname-a con 0x7f0cfc13faa0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0adeb0 con 0x7f0cfc13faa0 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0ae100 con 0x7f0cfc0b1850 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0ae3e0 con 0x7f0cfc0a96e0 2024-01-23T07:32:30.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.146+0000 7f0d02d1f640 10 monclient(hunting): authenticate will time out at 2343.389888s 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0cfbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc0ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d012bc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cfc13faa0 0x7f0cfc140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d00abb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 0x7f0cfc0abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d00abb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 0x7f0cfc0abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.173:54184/0 (socket says 172.21.15.173:54184) 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0cfbfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc0ac620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50206/0 (socket says 172.21.15.173:50206) 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d00abb640 1 -- 172.21.15.173:0/427100756 learned_addr learned my addr 172.21.15.173:0/427100756 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d00abb640 10 monclient(hunting): get_auth_request con 0x7f0cfc0a96e0 auth_method 0 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d00abb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d00abb640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d00abb640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d012bc640 10 monclient(hunting): get_auth_request con 0x7f0cfc13faa0 auth_method 0 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d012bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d012bc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0d012bc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0cfbfff640 10 monclient(hunting): get_auth_request con 0x7f0cfc0b1850 auth_method 0 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0cfbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0cfbfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.147+0000 7f0cfbfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.148+0000 7f0cfbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.148+0000 7f0cfbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.148+0000 7f0cfbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.148+0000 7f0d012bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.148+0000 7f0d012bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.148+0000 7f0d012bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.149+0000 7f0d00abb640 1 -- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 msgr2=0x7f0cfc0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.149+0000 7f0d00abb640 1 -- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 msgr2=0x7f0cfc0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-23T07:32:30.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.149+0000 7f0d00abb640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 0x7f0cfc0abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.149+0000 7f0d00abb640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 0x7f0cfc0abf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 10 monclient(hunting): handle_auth_done global_id 4117 payload 824 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 1 -- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 msgr2=0x7f0cfc0abf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 0x7f0cfc0abf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 1 -- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cfc13faa0 msgr2=0x7f0cfc140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cfc13faa0 0x7f0cfc140f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 10 monclient: _finish_hunting 0 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 1 monclient: found mon.noname-b 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.151+0000 7f0cfbfff640 1 -- 172.21.15.173:0/427100756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf4009a70 con 0x7f0cfc0b1850 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.153+0000 7f0cfbfff640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc0ac620 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800c410 tx=0x7f0ce800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.153+0000 7f0cf97fa640 10 client.?.objecter ms_handle_connect 0x7f0cfc0b1850 2024-01-23T07:32:30.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.153+0000 7f0cf97fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:30.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 1 -- 172.21.15.173:0/427100756 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce80035f0 con 0x7f0cfc0b1850 2024-01-23T07:32:30.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:30.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 10 monclient: dump: 2024-01-23T07:32:30.160 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.160 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 10 monclient: _finish_auth 0 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 10 monclient: _check_auth_tickets 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0cf97fa640 1 -- 172.21.15.173:0/427100756 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce8003750 con 0x7f0cfc0b1850 2024-01-23T07:32:30.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.156+0000 7f0d02d1f640 5 monclient: authenticate success, global_id 4117 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 monclient: _renew_subs 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc0accb0 con 0x7f0cfc0b1850 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0cf97fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0cf97fa640 1 -- 172.21.15.173:0/427100756 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8003b40 con 0x7f0cfc0b1850 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0cf97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0cf97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0cf97fa640 10 monclient: dump: 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.162 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0cfaffd640 4 set_mon_vals no callback set 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 client.4117.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 monclient: _renew_subs 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc141490 con 0x7f0cfc0b1850 2024-01-23T07:32:30.163 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 1 librados: init done 2024-01-23T07:32:30.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:30.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:30.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.157+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc067d70 con 0x7f0cfc0b1850 2024-01-23T07:32:30.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.178+0000 7f0cf97fa640 1 -- 172.21.15.173:0/427100756 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0ce8003ca0 con 0x7f0cfc0b1850 2024-01-23T07:32:30.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.178+0000 7f0cf97fa640 1 -- 172.21.15.173:0/427100756 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0ce8012810 con 0x7f0cfc0b1850 2024-01-23T07:32:30.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.178+0000 7f0cf97fa640 10 client.4117.objecter ms_dispatch 0x7f0cfc000b90 osd_map(2..2 src has 1..2) v4 2024-01-23T07:32:30.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.178+0000 7f0cf97fa640 3 client.4117.objecter handle_osd_map got epochs [2,2] > 0 2024-01-23T07:32:30.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.178+0000 7f0cf97fa640 3 client.4117.objecter handle_osd_map decoding full epoch 2 2024-01-23T07:32:30.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.178+0000 7f0cf97fa640 20 client.4117.objecter dump_active .. 0 homeless 2024-01-23T07:32:30.202 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:30.203+0000 7f2773e12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-23T07:32:30.255 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:30.256+0000 7f2773e12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-23T07:32:30.298 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:30.298+0000 7f46d2254040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-23T07:32:30.352 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:30.352+0000 7f46d2254040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-23T07:32:30.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.353+0000 7f0cf97fa640 1 -- 172.21.15.173:0/427100756 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f0ce8017070 con 0x7f0cfc0b1850 2024-01-23T07:32:30.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.353+0000 7f0cf97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:30.353 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.353+0000 7f0cf97fa640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:30.453 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.453+0000 7f0d02d1f640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "605eb632-aafd-48cf-8ee1-87217823fcc5", "id": 0}] 2024-01-23T07:32:30.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.453+0000 7f0d02d1f640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "605eb632-aafd-48cf-8ee1-87217823fcc5", "id": 0}] 2024-01-23T07:32:30.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.453+0000 7f0d02d1f640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.454 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.453+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "605eb632-aafd-48cf-8ee1-87217823fcc5", "id": 0} v 0) v1 -- 0x7f0cfc0acea0 con 0x7f0cfc0b1850 2024-01-23T07:32:30.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.641+0000 7f0cf97fa640 1 -- 172.21.15.173:0/427100756 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "605eb632-aafd-48cf-8ee1-87217823fcc5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ce8012af0 con 0x7f0cfc0b1850 2024-01-23T07:32:30.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.641+0000 7f0cf97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "605eb632-aafd-48cf-8ee1-87217823fcc5", "id": 0}] 2024-01-23T07:32:30.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.641+0000 7f0cf97fa640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:30.642 INFO:teuthology.orchestra.run.smithi173.stdout:0 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 10 librados: watch_flush enter 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 10 librados: watch_flush exit 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 20 client.4117.objecter shutdown clearing up homeless session... 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 10 client.4117.objecter successfully canceled tick 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 10 monclient: shutdown 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 msgr2=0x7f0cfc0ac620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc0ac620 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ce800c410 tx=0x7f0ce800c8d0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 shutdown_connections 2024-01-23T07:32:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0cfc13faa0 0x7f0cfc140f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0cfc0b1850 0x7f0cfc0ac620 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 --2- 172.21.15.173:0/427100756 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0cfc0a96e0 0x7f0cfc0abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 >> 172.21.15.173:0/427100756 conn(0x7f0cfc0b7bb0 msgr2=0x7f0cfc13f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.642+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 shutdown_connections 2024-01-23T07:32:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.643+0000 7f0d02d1f640 1 -- 172.21.15.173:0/427100756 wait complete. 2024-01-23T07:32:30.644 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.643+0000 7f0d02d1f640 1 librados: shutdown 2024-01-23T07:32:30.653 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 9460f714-f021-407b-964f-20aef6850158 1 2024-01-23T07:32:30.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.755+0000 7f084b6df640 10 monclient: get_monmap_and_config 2024-01-23T07:32:30.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.755+0000 7f084b6df640 10 monclient: build_initial_monmap 2024-01-23T07:32:30.755 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.755+0000 7f084b6df640 10 monclient: monmap: 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:30.756008+0000 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:30.756008+0000 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:30.756 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:30.757 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.755+0000 7f084b6df640 1 Processor -- start 2024-01-23T07:32:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.755+0000 7f084b6df640 1 -- start start 2024-01-23T07:32:30.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.755+0000 7f084b6df640 10 monclient: init 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f08440a96e0 0x7f08440b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient(hunting): picked mon.noname-c con 0x7f08440a96e0 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f084413f390 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 0x7f0844145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient(hunting): picked mon.noname-b con 0x7f0844145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08440aac10 con 0x7f084413f390 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.760 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08440a9e00 con 0x7f08440a96e0 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08440a9ac0 con 0x7f0844145600 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.756+0000 7f084b6df640 10 monclient(hunting): authenticate will time out at 2343.999482s 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f084947b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f08440a96e0 0x7f08440b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 0x7f0844145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0848c7a640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f084413f390 0x7f084413f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.173:39188/0 (socket says 172.21.15.173:39188) 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0848c7a640 1 -- 172.21.15.173:0/2061379105 learned_addr learned my addr 172.21.15.173:0/2061379105 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f084947b640 10 monclient(hunting): get_auth_request con 0x7f08440a96e0 auth_method 0 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f084947b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f084947b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f084947b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 10 monclient(hunting): get_auth_request con 0x7f0844145600 auth_method 0 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 1 -- 172.21.15.173:0/2061379105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 msgr2=0x7f0844145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 1 -- 172.21.15.173:0/2061379105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 msgr2=0x7f0844145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 1 --2- 172.21.15.173:0/2061379105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 0x7f0844145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.757+0000 7f0849c7c640 1 --2- 172.21.15.173:0/2061379105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 0x7f0844145a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.758+0000 7f084947b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.758+0000 7f084947b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.758+0000 7f084947b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 10 monclient(hunting): handle_auth_done global_id 4120 payload 274 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f083bfff640 1 -- 172.21.15.173:0/2061379105 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741272998 0 0) 0x7f08440aac10 con 0x7f084413f390 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 1 -- 172.21.15.173:0/2061379105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 msgr2=0x7f0844145a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 1 --2- 172.21.15.173:0/2061379105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 0x7f0844145a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 1 -- 172.21.15.173:0/2061379105 >> v1:172.21.15.116:6789/0 conn(0x7f084413f390 legacy=0x7f084413f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 10 monclient: _finish_hunting 0 2024-01-23T07:32:30.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 1 monclient: found mon.noname-c 2024-01-23T07:32:30.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:30.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f084947b640 1 -- 172.21.15.173:0/2061379105 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08440aae80 con 0x7f08440a96e0 2024-01-23T07:32:30.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.759+0000 7f083bfff640 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1 2024-01-23T07:32:30.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.761+0000 7f084947b640 1 --2- 172.21.15.173:0/2061379105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08440a96e0 0x7f08440b1850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08340097a0 tx=0x7f083402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccdf3cbd749fe9ea server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:30.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 1 -- 172.21.15.173:0/2061379105 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834031830 con 0x7f08440a96e0 2024-01-23T07:32:30.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:32:30.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: dump: 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: _finish_auth 0 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: _check_auth_tickets 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:30.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 1 -- 172.21.15.173:0/2061379105 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0834031990 con 0x7f08440a96e0 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f084b6df640 5 monclient: authenticate success, global_id 4120 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f084b6df640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f084b6df640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f084b6df640 4 set_mon_vals no callback set 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 1 -- 172.21.15.173:0/2061379105 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0834031d20 con 0x7f08440a96e0 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.765+0000 7f083bfff640 10 monclient: dump: 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.767 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.768 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.768 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.768 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.768 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.768 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 10 monclient: shutdown 2024-01-23T07:32:30.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:30.771 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 -- 172.21.15.173:0/2061379105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08440a96e0 msgr2=0x7f08440b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 --2- 172.21.15.173:0/2061379105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08440a96e0 0x7f08440b1850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f08340097a0 tx=0x7f083402b8d0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 -- 172.21.15.173:0/2061379105 shutdown_connections 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 --2- 172.21.15.173:0/2061379105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0844145600 0x7f0844145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 --2- 172.21.15.173:0/2061379105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f08440a96e0 0x7f08440b1850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 -- 172.21.15.173:0/2061379105 >> 172.21.15.173:0/2061379105 conn(0x7f08440b7bb0 msgr2=0x7f08440b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 -- 172.21.15.173:0/2061379105 shutdown_connections 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.766+0000 7f084b6df640 1 -- 172.21.15.173:0/2061379105 wait complete. 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.767+0000 7f084b6df640 10 monclient: build_initial_monmap 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.767+0000 7f084b6df640 10 monclient: monmap: 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:30.772 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.767+0000 7f084b6df640 1 librados: starting msgr at 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.767+0000 7f084b6df640 1 librados: starting objecter 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.767+0000 7f084b6df640 1 Processor -- start 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 -- start start 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 librados: setting wanted keys 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 librados: calling monclient init 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient: init 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:30.773 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08440a96e0 0x7f08441440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): picked mon.noname-c con 0x7f08440a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f084413f390 0x7f0844130c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): picked mon.noname-a con 0x7f084413f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0844145600 0x7f08441311c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): picked mon.noname-b con 0x7f0844145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08441374b0 con 0x7f084413f390 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0844131700 con 0x7f0844145600 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:30.774 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0844137700 con 0x7f08440a96e0 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.768+0000 7f084b6df640 10 monclient(hunting): authenticate will time out at 2344.011962s 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0849c7c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0844145600 0x7f08441311c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0848c7a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f084413f390 0x7f0844130c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0849c7c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0844145600 0x7f08441311c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50222/0 (socket says 172.21.15.173:50222) 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0849c7c640 1 -- 172.21.15.173:0/3195403462 learned_addr learned my addr 172.21.15.173:0/3195403462 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0849c7c640 10 monclient(hunting): get_auth_request con 0x7f0844145600 auth_method 0 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0849c7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0849c7c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0849c7c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0848c7a640 10 monclient(hunting): get_auth_request con 0x7f084413f390 auth_method 0 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0848c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0848c7a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:30.775 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.769+0000 7f0848c7a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:30.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.770+0000 7f0849c7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:30.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.770+0000 7f0849c7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:30.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.770+0000 7f0849c7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:30.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.770+0000 7f0848c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:30.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.770+0000 7f0848c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:30.776 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.770+0000 7f0848c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 10 monclient(hunting): handle_auth_done global_id 4123 payload 824 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 1 -- 172.21.15.173:0/3195403462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08440a96e0 msgr2=0x7f08441440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 1 --2- 172.21.15.173:0/3195403462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08440a96e0 0x7f08441440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 1 -- 172.21.15.173:0/3195403462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f084413f390 msgr2=0x7f0844130c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 1 --2- 172.21.15.173:0/3195403462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f084413f390 0x7f0844130c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 10 monclient: _finish_hunting 0 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 1 monclient: found mon.noname-b 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.772+0000 7f0849c7c640 1 -- 172.21.15.173:0/3195403462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009400 con 0x7f0844145600 2024-01-23T07:32:30.777 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.775+0000 7f0849c7c640 1 --2- 172.21.15.173:0/3195403462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0844145600 0x7f08441311c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f083c009fd0 tx=0x7f083c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:30.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.775+0000 7f0839ffb640 10 client.?.objecter ms_handle_connect 0x7f0844145600 2024-01-23T07:32:30.778 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.775+0000 7f0839ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 1 -- 172.21.15.173:0/3195403462 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c014420 con 0x7f0844145600 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: dump: 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.779 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: _finish_auth 0 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 1 -- 172.21.15.173:0/3195403462 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083c014580 con 0x7f0844145600 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 1 -- 172.21.15.173:0/3195403462 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083c014930 con 0x7f0844145600 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f0839ffb640 10 monclient: dump: 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:30.780 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 5 monclient: authenticate success, global_id 4123 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 10 monclient: _renew_subs 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f083b7fe640 4 set_mon_vals no callback set 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08440b74e0 con 0x7f0844145600 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 10 client.4123.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:30.781 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 10 monclient: _renew_subs 2024-01-23T07:32:30.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0844136200 con 0x7f0844145600 2024-01-23T07:32:30.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.778+0000 7f084b6df640 1 librados: init done 2024-01-23T07:32:30.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.780+0000 7f084b6df640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:30.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.780+0000 7f084b6df640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:30.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.780+0000 7f084b6df640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.782 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.780+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0844067d70 con 0x7f0844145600 2024-01-23T07:32:30.843 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:30.844+0000 7f2773e12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-23T07:32:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.884+0000 7f0839ffb640 1 -- 172.21.15.173:0/3195403462 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f083c014a90 con 0x7f0844145600 2024-01-23T07:32:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.884+0000 7f0839ffb640 1 -- 172.21.15.173:0/3195403462 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f083c01ee30 con 0x7f0844145600 2024-01-23T07:32:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.884+0000 7f0839ffb640 10 client.4123.objecter ms_dispatch 0x7f0844000b90 osd_map(3..3 src has 1..3) v4 2024-01-23T07:32:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.884+0000 7f0839ffb640 3 client.4123.objecter handle_osd_map got epochs [3,3] > 0 2024-01-23T07:32:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.884+0000 7f0839ffb640 3 client.4123.objecter handle_osd_map decoding full epoch 3 2024-01-23T07:32:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.884+0000 7f0839ffb640 20 client.4123.objecter dump_active .. 0 homeless 2024-01-23T07:32:30.885 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.884+0000 7f0839ffb640 1 -- 172.21.15.173:0/3195403462 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f083c028500 con 0x7f0844145600 2024-01-23T07:32:30.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.885+0000 7f0839ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:30.886 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.885+0000 7f0839ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:30.896 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:30.897+0000 7f2773e12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-23T07:32:30.914 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:30.914+0000 7f46d2254040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-23T07:32:30.944 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:30.941+0000 7f2773e12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-23T07:32:30.957 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.957+0000 7f084b6df640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9460f714-f021-407b-964f-20aef6850158", "id": 1}] 2024-01-23T07:32:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.957+0000 7f084b6df640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9460f714-f021-407b-964f-20aef6850158", "id": 1}] 2024-01-23T07:32:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.957+0000 7f084b6df640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:30.958 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:30.957+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9460f714-f021-407b-964f-20aef6850158", "id": 1} v 0) v1 -- 0x7f08440b1e30 con 0x7f0844145600 2024-01-23T07:32:30.969 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:30.969+0000 7f46d2254040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-23T07:32:30.996 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:30.997+0000 7f2773e12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-23T07:32:31.015 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.015+0000 7f46d2254040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-23T07:32:31.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.037+0000 7f0839ffb640 1 -- 172.21.15.173:0/3195403462 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9460f714-f021-407b-964f-20aef6850158", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f083c01e460 con 0x7f0844145600 2024-01-23T07:32:31.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.038+0000 7f0839ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9460f714-f021-407b-964f-20aef6850158", "id": 1}] 2024-01-23T07:32:31.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.038+0000 7f0839ffb640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:31.038 INFO:teuthology.orchestra.run.smithi173.stdout:1 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.038+0000 7f084b6df640 10 librados: watch_flush enter 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.038+0000 7f084b6df640 10 librados: watch_flush exit 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.038+0000 7f084b6df640 20 client.4123.objecter shutdown clearing up homeless session... 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.038+0000 7f084b6df640 10 client.4123.objecter successfully canceled tick 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 10 monclient: shutdown 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0844145600 msgr2=0x7f08441311c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 --2- 172.21.15.173:0/3195403462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0844145600 0x7f08441311c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f083c009fd0 tx=0x7f083c00e4b0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 shutdown_connections 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 --2- 172.21.15.173:0/3195403462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0844145600 0x7f08441311c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 --2- 172.21.15.173:0/3195403462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f084413f390 0x7f0844130c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 --2- 172.21.15.173:0/3195403462 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f08440a96e0 0x7f08441440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 >> 172.21.15.173:0/3195403462 conn(0x7f08440b7bb0 msgr2=0x7f0844135750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 shutdown_connections 2024-01-23T07:32:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 -- 172.21.15.173:0/3195403462 wait complete. 2024-01-23T07:32:31.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.039+0000 7f084b6df640 1 librados: shutdown 2024-01-23T07:32:31.049 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 407697c5-26b5-4614-aeba-2c970b770631 2 2024-01-23T07:32:31.050 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.050+0000 7f2773e12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-23T07:32:31.073 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.073+0000 7f46d2254040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-23T07:32:31.117 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.117+0000 7f46d2254040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-23T07:32:31.149 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.149+0000 7f831c32b640 10 monclient: get_monmap_and_config 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.149+0000 7f831c32b640 10 monclient: build_initial_monmap 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.149+0000 7f831c32b640 10 monclient: monmap: 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:31.150378+0000 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:31.150378+0000 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:31.150 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:31.151 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.149+0000 7f831c32b640 1 Processor -- start 2024-01-23T07:32:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 1 -- start start 2024-01-23T07:32:31.151 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient: init 2024-01-23T07:32:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient: _add_conns ranks=[0,4,1,2,3] 2024-01-23T07:32:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f83140a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:31.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f831413faa0 0x7f83140b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient(hunting): picked mon.noname-c con 0x7f831413faa0 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f8314145600 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140aac10 con 0x7f83140a96e0 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140a9ac0 con 0x7f8314145600 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140a9e00 con 0x7f831413faa0 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.150+0000 7f831c32b640 10 monclient(hunting): authenticate will time out at 2344.393829s 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.151+0000 7f83198c6640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f831413faa0 0x7f83140b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.151+0000 7f831a0c7640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f83140a96e0 0x7f831413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.173:39200/0 (socket says 172.21.15.173:39200) 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.151+0000 7f831a0c7640 1 -- 172.21.15.173:0/102823575 learned_addr learned my addr 172.21.15.173:0/102823575 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.152+0000 7f83198c6640 10 monclient(hunting): get_auth_request con 0x7f831413faa0 auth_method 0 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.152+0000 7f83198c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.152+0000 7f83198c6640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.152+0000 7f83198c6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.152+0000 7f83198c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.152+0000 7f83198c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.152+0000 7f83198c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.153+0000 7f83190c5640 1 -- 172.21.15.173:0/102823575 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797828970 0 0) 0x7f83140aac10 con 0x7f83140a96e0 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.153+0000 7f83190c5640 10 monclient(hunting): _negotiate 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.153+0000 7f83190c5640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.153+0000 7f83190c5640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.153+0000 7f83190c5640 10 monclient(hunting): my global_id is 4128 2024-01-23T07:32:31.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.153+0000 7f83190c5640 1 -- 172.21.15.173:0/102823575 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8300003520 con 0x7f83140a96e0 2024-01-23T07:32:31.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 10 monclient(hunting): handle_auth_done global_id 4126 payload 274 2024-01-23T07:32:31.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 1 -- 172.21.15.173:0/102823575 >> v1:172.21.15.173:6789/0 conn(0x7f8314145600 legacy=0x7f8314145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:31.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 1 -- 172.21.15.173:0/102823575 >> v1:172.21.15.116:6789/0 conn(0x7f83140a96e0 legacy=0x7f831413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 10 monclient: _finish_hunting 0 2024-01-23T07:32:31.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 1 monclient: found mon.noname-c 2024-01-23T07:32:31.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:31.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:32:31.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.155+0000 7f83198c6640 1 -- 172.21.15.173:0/102823575 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140aae80 con 0x7f831413faa0 2024-01-23T07:32:31.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.158+0000 7f83198c6640 1 --2- 172.21.15.173:0/102823575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 0x7f83140b1850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8304009790 tx=0x7f830402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56d2b3a46ad67ab5 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:31.158 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.159+0000 7f2773e12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 1 -- 172.21.15.173:0/102823575 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304031830 con 0x7f831413faa0 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: dump: 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.164 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: _finish_auth 0 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: _check_auth_tickets 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 1 -- 172.21.15.173:0/102823575 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8304031990 con 0x7f831413faa0 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f831c32b640 5 monclient: authenticate success, global_id 4126 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f831c32b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f831c32b640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f831c32b640 4 set_mon_vals no callback set 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 1 -- 172.21.15.173:0/102823575 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8304031d20 con 0x7f831413faa0 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:31.165 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.163+0000 7f83190c5640 10 monclient: dump: 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.166 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 10 monclient: shutdown 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 1 -- 172.21.15.173:0/102823575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 msgr2=0x7f83140b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 1 --2- 172.21.15.173:0/102823575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 0x7f83140b1850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8304009790 tx=0x7f830402b8d0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 1 -- 172.21.15.173:0/102823575 shutdown_connections 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 1 --2- 172.21.15.173:0/102823575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 0x7f83140b1850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 1 -- 172.21.15.173:0/102823575 >> 172.21.15.173:0/102823575 conn(0x7f83140b7bb0 msgr2=0x7f83140b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 1 -- 172.21.15.173:0/102823575 shutdown_connections 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.164+0000 7f831c32b640 1 -- 172.21.15.173:0/102823575 wait complete. 2024-01-23T07:32:31.170 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 10 monclient: build_initial_monmap 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 10 monclient: monmap: 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 1 librados: starting msgr at 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 1 librados: starting objecter 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 1 Processor -- start 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 1 -- start start 2024-01-23T07:32:31.171 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 1 librados: setting wanted keys 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 1 librados: calling monclient init 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.165+0000 7f831c32b640 10 monclient: init 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83140a96e0 0x7f8314134f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): picked mon.noname-c con 0x7f83140a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 0x7f83141328c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): picked mon.noname-b con 0x7f831413faa0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8314145600 0x7f8314132e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): picked mon.noname-a con 0x7f8314145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.172 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8314136300 con 0x7f8314145600 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8314143120 con 0x7f831413faa0 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8314142e70 con 0x7f83140a96e0 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.166+0000 7f831c32b640 10 monclient(hunting): authenticate will time out at 2344.409351s 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83140a96e0 0x7f8314134f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a8c8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8314145600 0x7f8314132e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f83198c6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 0x7f83141328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.173 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83140a96e0 0x7f8314134f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.173:54200/0 (socket says 172.21.15.173:54200) 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 1 -- 172.21.15.173:0/12690605 learned_addr learned my addr 172.21.15.173:0/12690605 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 10 monclient(hunting): get_auth_request con 0x7f83140a96e0 auth_method 0 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f83198c6640 10 monclient(hunting): get_auth_request con 0x7f831413faa0 auth_method 0 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f83198c6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f83198c6640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f83198c6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a8c8640 10 monclient(hunting): get_auth_request con 0x7f8314145600 auth_method 0 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a8c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a8c8640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a8c8640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.174 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.167+0000 7f831a0c7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.168+0000 7f831a8c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.168+0000 7f831a8c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.168+0000 7f831a8c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.168+0000 7f83198c6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.168+0000 7f83198c6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.168+0000 7f83198c6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 10 monclient(hunting): handle_auth_done global_id 4131 payload 824 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 1 -- 172.21.15.173:0/12690605 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83140a96e0 msgr2=0x7f8314134f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 1 --2- 172.21.15.173:0/12690605 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83140a96e0 0x7f8314134f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 1 -- 172.21.15.173:0/12690605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 msgr2=0x7f83141328c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 1 --2- 172.21.15.173:0/12690605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 0x7f83141328c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 10 monclient: _finish_hunting 0 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 1 monclient: found mon.noname-a 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.177 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.170+0000 7f831a8c8640 1 -- 172.21.15.173:0/12690605 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040093a0 con 0x7f8314145600 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.173+0000 7f831a8c8640 1 --2- 172.21.15.173:0/12690605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8314145600 0x7f8314132e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f830c00be20 tx=0x7f830c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.173+0000 7f830affd640 10 client.?.objecter ms_handle_connect 0x7f8314145600 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.173+0000 7f830affd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 1 -- 172.21.15.173:0/12690605 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00cdf0 con 0x7f8314145600 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: dump: 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.178 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: _finish_auth 0 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: _check_auth_tickets 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 1 -- 172.21.15.173:0/12690605 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c014440 con 0x7f8314145600 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 5 monclient: authenticate success, global_id 4131 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 10 monclient: _renew_subs 2024-01-23T07:32:31.179 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314146320 con 0x7f8314145600 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 1 -- 172.21.15.173:0/12690605 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c014830 con 0x7f8314145600 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830affd640 10 monclient: dump: 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.180 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f830bfff640 4 set_mon_vals no callback set 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 10 client.4131.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 10 monclient: _renew_subs 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8314142940 con 0x7f8314145600 2024-01-23T07:32:31.181 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.176+0000 7f831c32b640 1 librados: init done 2024-01-23T07:32:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.177+0000 7f831c32b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.177+0000 7f831c32b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.177+0000 7f831c32b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.177+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8314067d70 con 0x7f8314145600 2024-01-23T07:32:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.179+0000 7f830affd640 1 -- 172.21.15.173:0/12690605 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f830c014990 con 0x7f8314145600 2024-01-23T07:32:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.179+0000 7f830affd640 1 -- 172.21.15.173:0/12690605 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f830c01d7f0 con 0x7f8314145600 2024-01-23T07:32:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.179+0000 7f830affd640 10 client.4131.objecter ms_dispatch 0x7f8314000b90 osd_map(4..4 src has 1..4) v4 2024-01-23T07:32:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.179+0000 7f830affd640 3 client.4131.objecter handle_osd_map got epochs [4,4] > 0 2024-01-23T07:32:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.179+0000 7f830affd640 3 client.4131.objecter handle_osd_map decoding full epoch 4 2024-01-23T07:32:31.183 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.179+0000 7f830affd640 20 client.4131.objecter dump_active .. 0 homeless 2024-01-23T07:32:31.230 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.229+0000 7f46d2254040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-23T07:32:31.231 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.232+0000 7f2773e12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-23T07:32:31.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.276+0000 7f830affd640 1 -- 172.21.15.173:0/12690605 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f830c019070 con 0x7f8314145600 2024-01-23T07:32:31.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.276+0000 7f830affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.276 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.276+0000 7f830affd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:31.277 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.278+0000 7f2773e12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-23T07:32:31.300 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.300+0000 7f46d2254040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-23T07:32:31.328 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.329+0000 7f2773e12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-23T07:32:31.347 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.347+0000 7f46d2254040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-23T07:32:31.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.349+0000 7f831c32b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "407697c5-26b5-4614-aeba-2c970b770631", "id": 2}] 2024-01-23T07:32:31.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.349+0000 7f831c32b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "407697c5-26b5-4614-aeba-2c970b770631", "id": 2}] 2024-01-23T07:32:31.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.349+0000 7f831c32b640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.349 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.349+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "407697c5-26b5-4614-aeba-2c970b770631", "id": 2} v 0) v1 -- 0x7f8314142660 con 0x7f8314145600 2024-01-23T07:32:31.377 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.378+0000 7f2773e12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-23T07:32:31.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.382+0000 7f830affd640 1 -- 172.21.15.173:0/12690605 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "407697c5-26b5-4614-aeba-2c970b770631", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f830c014e30 con 0x7f8314145600 2024-01-23T07:32:31.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.382+0000 7f830affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "407697c5-26b5-4614-aeba-2c970b770631", "id": 2}] 2024-01-23T07:32:31.382 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.382+0000 7f830affd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:31.382 INFO:teuthology.orchestra.run.smithi173.stdout:2 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 10 librados: watch_flush enter 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 10 librados: watch_flush exit 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 20 client.4131.objecter shutdown clearing up homeless session... 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 10 client.4131.objecter successfully canceled tick 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 10 monclient: shutdown 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8314145600 msgr2=0x7f8314132e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 --2- 172.21.15.173:0/12690605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8314145600 0x7f8314132e00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f830c00be20 tx=0x7f830c00bf10 comp rx=0 tx=0).stop 2024-01-23T07:32:31.384 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 shutdown_connections 2024-01-23T07:32:31.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 --2- 172.21.15.173:0/12690605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8314145600 0x7f8314132e00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 --2- 172.21.15.173:0/12690605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f831413faa0 0x7f83141328c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 --2- 172.21.15.173:0/12690605 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f83140a96e0 0x7f8314134f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 >> 172.21.15.173:0/12690605 conn(0x7f83140b7bb0 msgr2=0x7f8314145a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:31.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 shutdown_connections 2024-01-23T07:32:31.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 -- 172.21.15.173:0/12690605 wait complete. 2024-01-23T07:32:31.385 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.383+0000 7f831c32b640 1 librados: shutdown 2024-01-23T07:32:31.394 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 9d99808b-6196-45a8-893e-5c5f192a7788 3 2024-01-23T07:32:31.413 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.413+0000 7f46d2254040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-23T07:32:31.465 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.465+0000 7f46d2254040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-23T07:32:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.513+0000 7f430e463640 10 monclient: get_monmap_and_config 2024-01-23T07:32:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.513+0000 7f430e463640 10 monclient: build_initial_monmap 2024-01-23T07:32:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.513+0000 7f430e463640 10 monclient: monmap: 2024-01-23T07:32:31.513 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:31.514133+0000 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:31.514133+0000 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:31.514 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 1 Processor -- start 2024-01-23T07:32:31.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 1 -- start start 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient: init 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient: _add_conns ranks=[3,0,1,2,4] 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f43080a96e0 0x7f43080b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient(hunting): picked mon.noname-a con 0x7f43080a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f430813f390 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4308145600 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43080aac10 con 0x7f430813f390 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43080a9ac0 con 0x7f4308145600 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43080a9e00 con 0x7f43080a96e0 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.514+0000 7f430e463640 10 monclient(hunting): authenticate will time out at 2344.757737s 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.515+0000 7f430ca00640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f4308145600 0x7f4308145a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45416/0 (socket says 172.21.15.173:45416) 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.515+0000 7f430ca00640 1 -- 172.21.15.173:0/60966555 learned_addr learned my addr 172.21.15.173:0/60966555 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.515+0000 7f4307fff640 1 --2- 172.21.15.173:0/60966555 >> v2:172.21.15.116:3300/0 conn(0x7f43080a96e0 0x7f43080b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.516+0000 7f4307fff640 10 monclient(hunting): get_auth_request con 0x7f43080a96e0 auth_method 0 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.516+0000 7f4307fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.516+0000 7f4307fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.516+0000 7f4307fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.516+0000 7f4307fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.516+0000 7f4307fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.516+0000 7f4307fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 10 monclient(hunting): handle_auth_done global_id 4134 payload 274 2024-01-23T07:32:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 1 -- 172.21.15.173:0/60966555 >> v1:172.21.15.173:6789/0 conn(0x7f4308145600 legacy=0x7f4308145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 1 -- 172.21.15.173:0/60966555 >> v1:172.21.15.116:6789/0 conn(0x7f430813f390 legacy=0x7f430813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 10 monclient: _finish_hunting 0 2024-01-23T07:32:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 1 monclient: found mon.noname-a 2024-01-23T07:32:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.519+0000 7f4307fff640 1 -- 172.21.15.173:0/60966555 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080aae80 con 0x7f43080a96e0 2024-01-23T07:32:31.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.523+0000 7f4307fff640 1 --2- 172.21.15.173:0/60966555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43080a96e0 0x7f43080b1850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89d404f9560b429 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 1 -- 172.21.15.173:0/60966555 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8030610 con 0x7f43080a96e0 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: dump: 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.527 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: _finish_auth 0 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: _check_auth_tickets 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 1 -- 172.21.15.173:0/60966555 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8030770 con 0x7f43080a96e0 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f430e463640 5 monclient: authenticate success, global_id 4134 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f430e463640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 1 -- 172.21.15.173:0/60966555 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8030b00 con 0x7f43080a96e0 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f430e463640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f430e463640 4 set_mon_vals no callback set 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.528 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.526+0000 7f4306ffd640 10 monclient: dump: 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.529 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.530 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.530 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.530 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.533 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 10 monclient: shutdown 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 1 -- 172.21.15.173:0/60966555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43080a96e0 msgr2=0x7f43080b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 1 --2- 172.21.15.173:0/60966555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43080a96e0 0x7f43080b1850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f42f80097a0 tx=0x7f42f802b960 comp rx=0 tx=0).stop 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 1 -- 172.21.15.173:0/60966555 shutdown_connections 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 1 --2- 172.21.15.173:0/60966555 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43080a96e0 0x7f43080b1850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 1 -- 172.21.15.173:0/60966555 >> 172.21.15.173:0/60966555 conn(0x7f43080b7bb0 msgr2=0x7f43080b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 1 -- 172.21.15.173:0/60966555 shutdown_connections 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.527+0000 7f430e463640 1 -- 172.21.15.173:0/60966555 wait complete. 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 10 monclient: build_initial_monmap 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 10 monclient: monmap: 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:31.534 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 1 librados: starting msgr at 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 1 librados: starting objecter 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 1 Processor -- start 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 1 -- start start 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 1 librados: setting wanted keys 2024-01-23T07:32:31.535 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 1 librados: calling monclient init 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.528+0000 7f430e463640 10 monclient: init 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43080a96e0 0x7f4308140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): picked mon.noname-c con 0x7f43080a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f430813f390 0x7f4308134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): picked mon.noname-a con 0x7f430813f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4308145600 0x7f4308131ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): picked mon.noname-b con 0x7f4308145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4308140890 con 0x7f430813f390 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4308141310 con 0x7f4308145600 2024-01-23T07:32:31.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43081415f0 con 0x7f43080a96e0 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.529+0000 7f430e463640 10 monclient(hunting): authenticate will time out at 2344.772525s 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f430ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4308145600 0x7f4308131ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f43077fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f430813f390 0x7f4308134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f4307fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43080a96e0 0x7f4308140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f430ca00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4308145600 0x7f4308131ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50246/0 (socket says 172.21.15.173:50246) 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f430ca00640 1 -- 172.21.15.173:0/1837004133 learned_addr learned my addr 172.21.15.173:0/1837004133 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f430ca00640 10 monclient(hunting): get_auth_request con 0x7f4308145600 auth_method 0 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f430ca00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f430ca00640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f430ca00640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f43077fe640 10 monclient(hunting): get_auth_request con 0x7f430813f390 auth_method 0 2024-01-23T07:32:31.537 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f43077fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f43077fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f43077fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f4307fff640 10 monclient(hunting): get_auth_request con 0x7f43080a96e0 auth_method 0 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f4307fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f4307fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.530+0000 7f4307fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f43077fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f43077fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f43077fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f430ca00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f430ca00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f430ca00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f4307fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f4307fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.538 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.531+0000 7f4307fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 10 monclient(hunting): handle_auth_done global_id 4135 payload 824 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 1 -- 172.21.15.173:0/1837004133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43080a96e0 msgr2=0x7f4308140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 1 --2- 172.21.15.173:0/1837004133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43080a96e0 0x7f4308140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 1 -- 172.21.15.173:0/1837004133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f430813f390 msgr2=0x7f4308134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 1 --2- 172.21.15.173:0/1837004133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f430813f390 0x7f4308134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 10 monclient: _finish_hunting 0 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 1 monclient: found mon.noname-b 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:32:31.539 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.533+0000 7f430ca00640 1 -- 172.21.15.173:0/1837004133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8009400 con 0x7f4308145600 2024-01-23T07:32:31.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.536+0000 7f430ca00640 1 --2- 172.21.15.173:0/1837004133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4308145600 0x7f4308131ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f430000caa0 tx=0x7f430000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:31.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.536+0000 7f4304ff9640 10 client.?.objecter ms_handle_connect 0x7f4308145600 2024-01-23T07:32:31.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.536+0000 7f4304ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:31.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 1 -- 172.21.15.173:0/1837004133 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000ab40 con 0x7f4308145600 2024-01-23T07:32:31.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:31.541 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: dump: 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: _finish_auth 0 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: _check_auth_tickets 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:31.542 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 1 -- 172.21.15.173:0/1837004133 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000aca0 con 0x7f4308145600 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 1 -- 172.21.15.173:0/1837004133 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4300012600 con 0x7f4308145600 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f4304ff9640 10 monclient: dump: 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.543 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 5 monclient: authenticate success, global_id 4135 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f43067fc640 4 set_mon_vals no callback set 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 10 monclient: _renew_subs 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4308146320 con 0x7f4308145600 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 10 client.4135.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 10 monclient: _renew_subs 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4308132000 con 0x7f4308145600 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.539+0000 7f430e463640 1 librados: init done 2024-01-23T07:32:31.544 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.540+0000 7f430e463640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.540+0000 7f430e463640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.540+0000 7f430e463640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.540+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4308067d70 con 0x7f4308145600 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.543+0000 7f4304ff9640 1 -- 172.21.15.173:0/1837004133 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f4300012760 con 0x7f4308145600 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.543+0000 7f4304ff9640 1 -- 172.21.15.173:0/1837004133 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4300007500 con 0x7f4308145600 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.543+0000 7f4304ff9640 10 client.4135.objecter ms_dispatch 0x7f4308000b90 osd_map(5..5 src has 1..5) v4 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.543+0000 7f4304ff9640 3 client.4135.objecter handle_osd_map got epochs [5,5] > 0 2024-01-23T07:32:31.545 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.543+0000 7f4304ff9640 3 client.4135.objecter handle_osd_map decoding full epoch 5 2024-01-23T07:32:31.546 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.544+0000 7f4304ff9640 20 client.4135.objecter dump_active .. 0 homeless 2024-01-23T07:32:31.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.664+0000 7f4304ff9640 1 -- 172.21.15.173:0/1837004133 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f4300021060 con 0x7f4308145600 2024-01-23T07:32:31.664 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.664+0000 7f4304ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.665 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.664+0000 7f4304ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:31.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.739+0000 7f430e463640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9d99808b-6196-45a8-893e-5c5f192a7788", "id": 3}] 2024-01-23T07:32:31.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.739+0000 7f430e463640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9d99808b-6196-45a8-893e-5c5f192a7788", "id": 3}] 2024-01-23T07:32:31.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.739+0000 7f430e463640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:31.739 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.739+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d99808b-6196-45a8-893e-5c5f192a7788", "id": 3} v 0) v1 -- 0x7f4308140a40 con 0x7f4308145600 2024-01-23T07:32:31.787 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.788+0000 7f2773e12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-23T07:32:31.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.808+0000 7f4304ff9640 1 -- 172.21.15.173:0/1837004133 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d99808b-6196-45a8-893e-5c5f192a7788", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4308140a40 con 0x7f4308145600 2024-01-23T07:32:31.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.808+0000 7f4304ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9d99808b-6196-45a8-893e-5c5f192a7788", "id": 3}] 2024-01-23T07:32:31.808 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.808+0000 7f4304ff9640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:31.808 INFO:teuthology.orchestra.run.smithi173.stdout:3 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 10 librados: watch_flush enter 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 10 librados: watch_flush exit 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 20 client.4135.objecter shutdown clearing up homeless session... 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 10 client.4135.objecter successfully canceled tick 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 10 monclient: shutdown 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4308145600 msgr2=0x7f4308131ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 --2- 172.21.15.173:0/1837004133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4308145600 0x7f4308131ac0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f430000caa0 tx=0x7f430000cf60 comp rx=0 tx=0).stop 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 shutdown_connections 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 --2- 172.21.15.173:0/1837004133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4308145600 0x7f4308131ac0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.810 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 --2- 172.21.15.173:0/1837004133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f430813f390 0x7f4308134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 --2- 172.21.15.173:0/1837004133 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f43080a96e0 0x7f4308140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 >> 172.21.15.173:0/1837004133 conn(0x7f43080b7bb0 msgr2=0x7f430813c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:31.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 shutdown_connections 2024-01-23T07:32:31.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 -- 172.21.15.173:0/1837004133 wait complete. 2024-01-23T07:32:31.811 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.809+0000 7f430e463640 1 librados: shutdown 2024-01-23T07:32:31.820 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 991b5dca-bb22-4f89-9209-1facdeb4465c 4 2024-01-23T07:32:31.893 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:31.893+0000 7f46d2254040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-23T07:32:31.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.919+0000 7f15936df640 10 monclient: get_monmap_and_config 2024-01-23T07:32:31.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.919+0000 7f15936df640 10 monclient: build_initial_monmap 2024-01-23T07:32:31.919 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.919+0000 7f15936df640 10 monclient: monmap: 2024-01-23T07:32:31.919 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:31.919 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.919 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:31.920303+0000 2024-01-23T07:32:31.919 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:31.920303+0000 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:31.920 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.919+0000 7f15936df640 1 Processor -- start 2024-01-23T07:32:31.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 1 -- start start 2024-01-23T07:32:31.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient: init 2024-01-23T07:32:31.922 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f158c0a96e0 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c13faa0 0x7f158c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient(hunting): picked mon.noname-b con 0x7f158c13faa0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f158c145600 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c0aac10 con 0x7f158c145600 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158c0a9ac0 con 0x7f158c0a96e0 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c0a9e00 con 0x7f158c13faa0 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.920+0000 7f15936df640 10 monclient(hunting): authenticate will time out at 2345.163783s 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.921+0000 7f159147b640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f158c0a96e0 0x7f158c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45418/0 (socket says 172.21.15.173:45418) 2024-01-23T07:32:31.923 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.921+0000 7f159147b640 1 -- 172.21.15.173:0/1409235041 learned_addr learned my addr 172.21.15.173:0/1409235041 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.921+0000 7f1590c7a640 1 --2- 172.21.15.173:0/1409235041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c13faa0 0x7f158c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.921+0000 7f1590c7a640 10 monclient(hunting): get_auth_request con 0x7f158c13faa0 auth_method 0 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.921+0000 7f1590c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.921+0000 7f1590c7a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.921+0000 7f1590c7a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.922+0000 7f1590c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.922+0000 7f1590c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.924 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.922+0000 7f1590c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 1 -- 172.21.15.173:0/1409235041 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910638157 0 0) 0x7f158c0aac10 con 0x7f158c145600 2024-01-23T07:32:31.925 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): _negotiate 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): my global_id is 4143 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 1 -- 172.21.15.173:0/1409235041 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1578003520 con 0x7f158c145600 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 1 -- 172.21.15.173:0/1409235041 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143825789 0 0) 0x7f158c0a9ac0 con 0x7f158c0a96e0 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): _negotiate 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 10 monclient(hunting): my global_id is 4138 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.923+0000 7f1583fff640 1 -- 172.21.15.173:0/1409235041 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f158c0aac10 con 0x7f158c0a96e0 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 10 monclient(hunting): handle_auth_done global_id 14108 payload 274 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 1 -- 172.21.15.173:0/1409235041 >> v1:172.21.15.173:6789/0 conn(0x7f158c0a96e0 legacy=0x7f158c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.926 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 1 -- 172.21.15.173:0/1409235041 >> v1:172.21.15.116:6789/0 conn(0x7f158c145600 legacy=0x7f158c145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 10 monclient: _finish_hunting 0 2024-01-23T07:32:31.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 1 monclient: found mon.noname-b 2024-01-23T07:32:31.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:31.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:32:31.927 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.925+0000 7f1590c7a640 1 -- 172.21.15.173:0/1409235041 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c0aae80 con 0x7f158c13faa0 2024-01-23T07:32:31.929 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.929+0000 7f1590c7a640 1 --2- 172.21.15.173:0/1409235041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c13faa0 0x7f158c0b1850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f15880097c0 tx=0x7f158802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b583c83d679221a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:31.929 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:31.930+0000 7f2773e12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-23T07:32:31.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.969+0000 7f1583fff640 1 -- 172.21.15.173:0/1409235041 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588031890 con 0x7f158c13faa0 2024-01-23T07:32:31.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.969+0000 7f1583fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.969+0000 7f1583fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:31.970 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.969+0000 7f1583fff640 10 monclient: dump: 2024-01-23T07:32:31.970 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.970 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 10 monclient: _finish_auth 0 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 10 monclient: _check_auth_tickets 2024-01-23T07:32:31.971 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 1 -- 172.21.15.173:0/1409235041 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15880319f0 con 0x7f158c13faa0 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 1 -- 172.21.15.173:0/1409235041 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588031d80 con 0x7f158c13faa0 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f1583fff640 10 monclient: dump: 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.972 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 5 monclient: authenticate success, global_id 14108 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:31.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 4 set_mon_vals no callback set 2024-01-23T07:32:31.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 10 monclient: shutdown 2024-01-23T07:32:31.977 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 1 -- 172.21.15.173:0/1409235041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c13faa0 msgr2=0x7f158c0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 1 --2- 172.21.15.173:0/1409235041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c13faa0 0x7f158c0b1850 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f15880097c0 tx=0x7f158802b930 comp rx=0 tx=0).stop 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 1 -- 172.21.15.173:0/1409235041 shutdown_connections 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 1 --2- 172.21.15.173:0/1409235041 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c13faa0 0x7f158c0b1850 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.970+0000 7f15936df640 1 -- 172.21.15.173:0/1409235041 >> 172.21.15.173:0/1409235041 conn(0x7f158c0b7bb0 msgr2=0x7f158c0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.971+0000 7f15936df640 1 -- 172.21.15.173:0/1409235041 shutdown_connections 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.971+0000 7f15936df640 1 -- 172.21.15.173:0/1409235041 wait complete. 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.971+0000 7f15936df640 10 monclient: build_initial_monmap 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.971+0000 7f15936df640 10 monclient: monmap: 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:31.978 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.971+0000 7f15936df640 1 librados: starting msgr at 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.971+0000 7f15936df640 1 librados: starting objecter 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 Processor -- start 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 -- start start 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 librados: setting wanted keys 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 librados: calling monclient init 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient: init 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:32:31.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c0a96e0 0x7f158c13b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): picked mon.noname-c con 0x7f158c0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158c13faa0 0x7f158c135a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): picked mon.noname-a con 0x7f158c13faa0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f158c145600 0x7f158c142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): picked mon.noname-b con 0x7f158c145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c135f40 con 0x7f158c13faa0 2024-01-23T07:32:31.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c132b50 con 0x7f158c145600 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158c141870 con 0x7f158c0a96e0 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.972+0000 7f15936df640 10 monclient(hunting): authenticate will time out at 2345.215612s 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1591c7c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f158c145600 0x7f158c142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1590c7a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158c13faa0 0x7f158c135a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1590c7a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158c13faa0 0x7f158c135a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.173:55936/0 (socket says 172.21.15.173:55936) 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1590c7a640 1 -- 172.21.15.173:0/913344670 learned_addr learned my addr 172.21.15.173:0/913344670 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1590c7a640 10 monclient(hunting): get_auth_request con 0x7f158c13faa0 auth_method 0 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1590c7a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1590c7a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1590c7a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1591c7c640 10 monclient(hunting): get_auth_request con 0x7f158c145600 auth_method 0 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1591c7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1591c7c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.973+0000 7f1591c7c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.974+0000 7f1590c7a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.974+0000 7f1590c7a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.974+0000 7f1590c7a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.974+0000 7f1591c7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.974+0000 7f1591c7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.974+0000 7f1591c7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 10 monclient(hunting): handle_auth_done global_id 4146 payload 824 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 1 -- 172.21.15.173:0/913344670 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c0a96e0 msgr2=0x7f158c13b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 1 --2- 172.21.15.173:0/913344670 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c0a96e0 0x7f158c13b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 1 -- 172.21.15.173:0/913344670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f158c145600 msgr2=0x7f158c142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:31.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 1 --2- 172.21.15.173:0/913344670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f158c145600 0x7f158c142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:31.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 10 monclient: _finish_hunting 0 2024-01-23T07:32:31.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 1 monclient: found mon.noname-a 2024-01-23T07:32:31.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:31.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.976+0000 7f1590c7a640 1 -- 172.21.15.173:0/913344670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15880093a0 con 0x7f158c13faa0 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.978+0000 7f1590c7a640 1 --2- 172.21.15.173:0/913344670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158c13faa0 0x7f158c135a00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f158802bf40 tx=0x7f15880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.978+0000 7f1581ffb640 10 client.?.objecter ms_handle_connect 0x7f158c13faa0 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.978+0000 7f1581ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f1581ffb640 1 -- 172.21.15.173:0/913344670 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158803bbf0 con 0x7f158c13faa0 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f1581ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f1581ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f1581ffb640 10 monclient: dump: 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.985 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f1581ffb640 10 monclient: _finish_auth 0 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f1581ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f1581ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f15936df640 5 monclient: authenticate success, global_id 4146 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f15936df640 10 monclient: _renew_subs 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f15936df640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.980+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c1355e0 con 0x7f158c13faa0 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 10 client.4146.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 10 monclient: _renew_subs 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c141610 con 0x7f158c13faa0 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 1 librados: init done 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.981+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c067d70 con 0x7f158c13faa0 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.982+0000 7f1581ffb640 1 -- 172.21.15.173:0/913344670 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158803bd50 con 0x7f158c13faa0 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.982+0000 7f1581ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.982+0000 7f1581ffb640 1 -- 172.21.15.173:0/913344670 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158804e650 con 0x7f158c13faa0 2024-01-23T07:32:31.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.982+0000 7f1581ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.982+0000 7f1581ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.982+0000 7f1581ffb640 10 monclient: dump: 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:31.988 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:31.982+0000 7f15837fe640 4 set_mon_vals no callback set 2024-01-23T07:32:32.031 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:32.031+0000 7f46d2254040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-23T07:32:32.061 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:32.062+0000 7f2773e12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-23T07:32:32.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.076+0000 7f1581ffb640 1 -- 172.21.15.173:0/913344670 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f158804ec20 con 0x7f158c13faa0 2024-01-23T07:32:32.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.076+0000 7f1581ffb640 1 -- 172.21.15.173:0/913344670 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f15880308f0 con 0x7f158c13faa0 2024-01-23T07:32:32.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.076+0000 7f1581ffb640 10 client.4146.objecter ms_dispatch 0x7f158c000b90 osd_map(6..6 src has 1..6) v4 2024-01-23T07:32:32.076 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.076+0000 7f1581ffb640 3 client.4146.objecter handle_osd_map got epochs [6,6] > 0 2024-01-23T07:32:32.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.076+0000 7f1581ffb640 3 client.4146.objecter handle_osd_map decoding full epoch 6 2024-01-23T07:32:32.077 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.076+0000 7f1581ffb640 20 client.4146.objecter dump_active .. 0 homeless 2024-01-23T07:32:32.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.080+0000 7f1581ffb640 1 -- 172.21.15.173:0/913344670 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f1588035020 con 0x7f158c13faa0 2024-01-23T07:32:32.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.080+0000 7f1581ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:32.080 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.080+0000 7f1581ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:32.106 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:32.107+0000 7f2773e12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-23T07:32:32.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.152+0000 7f15936df640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "991b5dca-bb22-4f89-9209-1facdeb4465c", "id": 4}] 2024-01-23T07:32:32.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.153+0000 7f15936df640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "991b5dca-bb22-4f89-9209-1facdeb4465c", "id": 4}] 2024-01-23T07:32:32.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.153+0000 7f15936df640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.153 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.153+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "991b5dca-bb22-4f89-9209-1facdeb4465c", "id": 4} v 0) v1 -- 0x7f158c142010 con 0x7f158c13faa0 2024-01-23T07:32:32.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.182+0000 7f1581ffb640 1 -- 172.21.15.173:0/913344670 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "991b5dca-bb22-4f89-9209-1facdeb4465c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1588030b00 con 0x7f158c13faa0 2024-01-23T07:32:32.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.182+0000 7f1581ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "991b5dca-bb22-4f89-9209-1facdeb4465c", "id": 4}] 2024-01-23T07:32:32.182 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.182+0000 7f1581ffb640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:32.182 INFO:teuthology.orchestra.run.smithi173.stdout:4 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.182+0000 7f15936df640 10 librados: watch_flush enter 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.182+0000 7f15936df640 10 librados: watch_flush exit 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.182+0000 7f15936df640 20 client.4146.objecter shutdown clearing up homeless session... 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.182+0000 7f15936df640 10 client.4146.objecter successfully canceled tick 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 10 monclient: shutdown 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158c13faa0 msgr2=0x7f158c135a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 --2- 172.21.15.173:0/913344670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158c13faa0 0x7f158c135a00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f158802bf40 tx=0x7f15880046c0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 shutdown_connections 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 --2- 172.21.15.173:0/913344670 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f158c145600 0x7f158c142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 --2- 172.21.15.173:0/913344670 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f158c13faa0 0x7f158c135a00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.184 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 --2- 172.21.15.173:0/913344670 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f158c0a96e0 0x7f158c13b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 >> 172.21.15.173:0/913344670 conn(0x7f158c0b7bb0 msgr2=0x7f158c139210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:32.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 shutdown_connections 2024-01-23T07:32:32.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 -- 172.21.15.173:0/913344670 wait complete. 2024-01-23T07:32:32.185 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.183+0000 7f15936df640 1 librados: shutdown 2024-01-23T07:32:32.193 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new dba9e892-ba26-4aef-9e65-c923978b44d4 5 2024-01-23T07:32:32.209 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:32.210+0000 7f2773e12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-23T07:32:32.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.290+0000 7f69cc9e1640 10 monclient: get_monmap_and_config 2024-01-23T07:32:32.290 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.290+0000 7f69cc9e1640 10 monclient: build_initial_monmap 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.290+0000 7f69cc9e1640 10 monclient: monmap: 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:32.291269+0000 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:32.291269+0000 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:32.291 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:32.292 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:32.292 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:32.292 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.290+0000 7f69cc9e1640 1 Processor -- start 2024-01-23T07:32:32.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.290+0000 7f69cc9e1640 1 -- start start 2024-01-23T07:32:32.292 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.290+0000 7f69cc9e1640 10 monclient: init 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c806b200 0x7f69c81425e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient(hunting): picked mon.noname-b con 0x7f69c806b200 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f69c80ad880 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f69c813f8c0 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c806d170 con 0x7f69c80ad880 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69c806d450 con 0x7f69c813f8c0 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c81420c0 con 0x7f69c806b200 2024-01-23T07:32:32.295 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.291+0000 7f69cc9e1640 10 monclient(hunting): authenticate will time out at 2345.534651s 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.292+0000 7f69c6d9d640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f69c813f8c0 0x7f69c814c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45420/0 (socket says 172.21.15.173:45420) 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.292+0000 7f69c6d9d640 1 -- 172.21.15.173:0/1592569185 learned_addr learned my addr 172.21.15.173:0/1592569185 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.292+0000 7f69c659c640 1 --2- 172.21.15.173:0/1592569185 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c806b200 0x7f69c81425e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.292+0000 7f69c659c640 10 monclient(hunting): get_auth_request con 0x7f69c806b200 auth_method 0 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.292+0000 7f69c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.292+0000 7f69c659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.292+0000 7f69c659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.293+0000 7f69c659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.293+0000 7f69c659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.293+0000 7f69c659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.296 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 1 -- 172.21.15.173:0/1592569185 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850444273 0 0) 0x7f69c806d450 con 0x7f69c813f8c0 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): _negotiate 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): my global_id is 4144 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 1 -- 172.21.15.173:0/1592569185 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69b0003520 con 0x7f69c813f8c0 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 1 -- 172.21.15.173:0/1592569185 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949520199 0 0) 0x7f69c806d170 con 0x7f69c80ad880 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): _negotiate 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 10 monclient(hunting): my global_id is 4149 2024-01-23T07:32:32.297 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.294+0000 7f69c559a640 1 -- 172.21.15.173:0/1592569185 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69c806d450 con 0x7f69c80ad880 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 10 monclient(hunting): handle_auth_done global_id 14111 payload 274 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 1 -- 172.21.15.173:0/1592569185 >> v1:172.21.15.173:6789/0 conn(0x7f69c813f8c0 legacy=0x7f69c814c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 1 -- 172.21.15.173:0/1592569185 >> v1:172.21.15.116:6789/0 conn(0x7f69c80ad880 legacy=0x7f69c813f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 10 monclient: _finish_hunting 0 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 1 monclient: found mon.noname-b 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:32:32.298 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.295+0000 7f69c659c640 1 -- 172.21.15.173:0/1592569185 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c806d730 con 0x7f69c806b200 2024-01-23T07:32:32.299 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.298+0000 7f69c659c640 1 --2- 172.21.15.173:0/1592569185 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c806b200 0x7f69c81425e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f69b80097d0 tx=0x7f69b802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=685aed7431ccb2d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 1 -- 172.21.15.173:0/1592569185 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8031800 con 0x7f69c806b200 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: dump: 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.303 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: _finish_auth 0 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: _check_auth_tickets 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 1 -- 172.21.15.173:0/1592569185 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b8031960 con 0x7f69c806b200 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 1 -- 172.21.15.173:0/1592569185 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8031cf0 con 0x7f69c806b200 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69cc9e1640 5 monclient: authenticate success, global_id 14111 2024-01-23T07:32:32.304 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69cc9e1640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69cc9e1640 4 set_mon_vals no callback set 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69c559a640 10 monclient: dump: 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.305 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69cc9e1640 10 monclient: shutdown 2024-01-23T07:32:32.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69cc9e1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69cc9e1640 1 -- 172.21.15.173:0/1592569185 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c806b200 msgr2=0x7f69c81425e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.303+0000 7f69cc9e1640 1 --2- 172.21.15.173:0/1592569185 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c806b200 0x7f69c81425e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f69b80097d0 tx=0x7f69b802b8a0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.304+0000 7f69cc9e1640 1 -- 172.21.15.173:0/1592569185 shutdown_connections 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.304+0000 7f69cc9e1640 1 --2- 172.21.15.173:0/1592569185 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c806b200 0x7f69c81425e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.304+0000 7f69cc9e1640 1 -- 172.21.15.173:0/1592569185 >> 172.21.15.173:0/1592569185 conn(0x7f69c80b1f50 msgr2=0x7f69c80af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.304+0000 7f69cc9e1640 1 -- 172.21.15.173:0/1592569185 shutdown_connections 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.304+0000 7f69cc9e1640 1 -- 172.21.15.173:0/1592569185 wait complete. 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.304+0000 7f69cc9e1640 10 monclient: build_initial_monmap 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.304+0000 7f69cc9e1640 10 monclient: monmap: 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:32.310 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 librados: starting msgr at 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 librados: starting objecter 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 Processor -- start 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 -- start start 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 librados: setting wanted keys 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 librados: calling monclient init 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient: init 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:32.311 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69c806b200 0x7f69c811c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): picked mon.noname-a con 0x7f69c806b200 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c80ad880 0x7f69c81d7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): picked mon.noname-b con 0x7f69c80ad880 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c813f8c0 0x7f69c81d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): picked mon.noname-c con 0x7f69c813f8c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c811dea0 con 0x7f69c806b200 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69c81d7130 con 0x7f69c80ad880 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69c811e0f0 con 0x7f69c813f8c0 2024-01-23T07:32:32.312 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.305+0000 7f69cc9e1640 10 monclient(hunting): authenticate will time out at 2345.548779s 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c80ad880 0x7f69c81d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69c806b200 0x7f69c811c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c6d9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c813f8c0 0x7f69c81d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c80ad880 0x7f69c81d7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:50266/0 (socket says 172.21.15.173:50266) 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c5d9b640 1 -- 172.21.15.173:0/3899243289 learned_addr learned my addr 172.21.15.173:0/3899243289 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c5d9b640 10 monclient(hunting): get_auth_request con 0x7f69c80ad880 auth_method 0 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c5d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c659c640 10 monclient(hunting): get_auth_request con 0x7f69c806b200 auth_method 0 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.313 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c6d9d640 10 monclient(hunting): get_auth_request con 0x7f69c813f8c0 auth_method 0 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c6d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.306+0000 7f69c6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.307+0000 7f69c6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 10 monclient(hunting): handle_auth_done global_id 4152 payload 824 2024-01-23T07:32:32.314 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 1 -- 172.21.15.173:0/3899243289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c813f8c0 msgr2=0x7f69c81d7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c813f8c0 0x7f69c81d7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 1 -- 172.21.15.173:0/3899243289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c80ad880 msgr2=0x7f69c81d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c80ad880 0x7f69c81d7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 10 monclient: _finish_hunting 0 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 1 monclient: found mon.noname-a 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c659c640 1 -- 172.21.15.173:0/3899243289 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b8009400 con 0x7f69c806b200 2024-01-23T07:32:32.315 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.309+0000 7f69c5d9b640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c80ad880 0x7f69c81d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T07:32:32.316 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:32.310+0000 7f2773e12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.311+0000 7f69c659c640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69c806b200 0x7f69c811c7f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69b8033000 tx=0x7f69b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.312+0000 7f69b6ffd640 10 client.?.objecter ms_handle_connect 0x7f69c806b200 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.312+0000 7f69b6ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 1 -- 172.21.15.173:0/3899243289 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b803bcb0 con 0x7f69c806b200 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: dump: 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.317 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: _finish_auth 0 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: _check_auth_tickets 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 1 -- 172.21.15.173:0/3899243289 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b803be50 con 0x7f69c806b200 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 5 monclient: authenticate success, global_id 4152 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 10 monclient: _renew_subs 2024-01-23T07:32:32.318 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69c806e720 con 0x7f69c806b200 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 1 -- 172.21.15.173:0/3899243289 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b8045630 con 0x7f69c806b200 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69b6ffd640 10 monclient: dump: 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.319 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69c4d99640 4 set_mon_vals no callback set 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 10 client.4152.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 10 monclient: _renew_subs 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69c80715b0 con 0x7f69c806b200 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.315+0000 7f69cc9e1640 1 librados: init done 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.316+0000 7f69cc9e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.316+0000 7f69cc9e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.316+0000 7f69cc9e1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.320 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.316+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69c81d72f0 con 0x7f69c806b200 2024-01-23T07:32:32.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.319+0000 7f69b6ffd640 1 -- 172.21.15.173:0/3899243289 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f69b8045b20 con 0x7f69c806b200 2024-01-23T07:32:32.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.319+0000 7f69b6ffd640 1 -- 172.21.15.173:0/3899243289 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f69b802e070 con 0x7f69c806b200 2024-01-23T07:32:32.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.319+0000 7f69b6ffd640 10 client.4152.objecter ms_dispatch 0x7f69c8000b90 osd_map(7..7 src has 1..7) v4 2024-01-23T07:32:32.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.319+0000 7f69b6ffd640 3 client.4152.objecter handle_osd_map got epochs [7,7] > 0 2024-01-23T07:32:32.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.319+0000 7f69b6ffd640 3 client.4152.objecter handle_osd_map decoding full epoch 7 2024-01-23T07:32:32.321 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.319+0000 7f69b6ffd640 20 client.4152.objecter dump_active .. 0 homeless 2024-01-23T07:32:32.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.415+0000 7f69b6ffd640 1 -- 172.21.15.173:0/3899243289 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f69b8035020 con 0x7f69c806b200 2024-01-23T07:32:32.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.415+0000 7f69b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:32.415 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.415+0000 7f69b6ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:32.444 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:32.444+0000 7f46d2254040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-23T07:32:32.451 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:32.452+0000 7f2773e12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-23T07:32:32.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.486+0000 7f69cc9e1640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "dba9e892-ba26-4aef-9e65-c923978b44d4", "id": 5}] 2024-01-23T07:32:32.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.486+0000 7f69cc9e1640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "dba9e892-ba26-4aef-9e65-c923978b44d4", "id": 5}] 2024-01-23T07:32:32.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.486+0000 7f69cc9e1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.487 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.486+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dba9e892-ba26-4aef-9e65-c923978b44d4", "id": 5} v 0) v1 -- 0x7f69c811e230 con 0x7f69c806b200 2024-01-23T07:32:32.490 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:32.490+0000 7f46d2254040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-23T07:32:32.493 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:32.494+0000 7f2773e12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-23T07:32:32.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.517+0000 7f69b6ffd640 1 -- 172.21.15.173:0/3899243289 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dba9e892-ba26-4aef-9e65-c923978b44d4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f69c811e230 con 0x7f69c806b200 2024-01-23T07:32:32.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.517+0000 7f69b6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "dba9e892-ba26-4aef-9e65-c923978b44d4", "id": 5}] 2024-01-23T07:32:32.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.517+0000 7f69b6ffd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:32.517 INFO:teuthology.orchestra.run.smithi173.stdout:5 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 10 librados: watch_flush enter 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 10 librados: watch_flush exit 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 20 client.4152.objecter shutdown clearing up homeless session... 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 10 client.4152.objecter successfully canceled tick 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 10 monclient: shutdown 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69c806b200 msgr2=0x7f69c811c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69c806b200 0x7f69c811c7f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f69b8033000 tx=0x7f69b80046c0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 shutdown_connections 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f69c813f8c0 0x7f69c81d7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69c80ad880 0x7f69c81d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 --2- 172.21.15.173:0/3899243289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f69c806b200 0x7f69c811c7f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 >> 172.21.15.173:0/3899243289 conn(0x7f69c80b1f50 msgr2=0x7f69c8139c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:32.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 shutdown_connections 2024-01-23T07:32:32.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 -- 172.21.15.173:0/3899243289 wait complete. 2024-01-23T07:32:32.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.518+0000 7f69cc9e1640 1 librados: shutdown 2024-01-23T07:32:32.529 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 94e52b13-76ee-4bb4-b205-3cdcd0b70319 6 2024-01-23T07:32:32.593 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:32.593+0000 7f46d2254040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-23T07:32:32.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.628+0000 7ff454e99640 10 monclient: get_monmap_and_config 2024-01-23T07:32:32.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.628+0000 7ff454e99640 10 monclient: build_initial_monmap 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.628+0000 7ff454e99640 10 monclient: monmap: 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:32.629281+0000 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:32.629281+0000 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.628+0000 7ff454e99640 1 Processor -- start 2024-01-23T07:32:32.629 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.628+0000 7ff454e99640 1 -- start start 2024-01-23T07:32:32.630 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.628+0000 7ff454e99640 10 monclient: init 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff4500a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff45013faa0 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7ff4500b1850 0x7ff450145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient(hunting): picked mon.noname-a con 0x7ff4500b1850 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500aac10 con 0x7ff4500a96e0 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4500a9ac0 con 0x7ff45013faa0 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4500a9e00 con 0x7ff4500b1850 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:32.631 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.629+0000 7ff454e99640 10 monclient(hunting): authenticate will time out at 2345.872775s 2024-01-23T07:32:32.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.630+0000 7ff44dd9b640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7ff45013faa0 0x7ff450145600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45422/0 (socket says 172.21.15.173:45422) 2024-01-23T07:32:32.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.630+0000 7ff44dd9b640 1 -- 172.21.15.173:0/618435009 learned_addr learned my addr 172.21.15.173:0/618435009 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:32.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.630+0000 7ff44ed9d640 1 --2- 172.21.15.173:0/618435009 >> v2:172.21.15.116:3300/0 conn(0x7ff4500b1850 0x7ff450145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.630+0000 7ff44ed9d640 10 monclient(hunting): get_auth_request con 0x7ff4500b1850 auth_method 0 2024-01-23T07:32:32.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.630+0000 7ff44ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.630+0000 7ff44ed9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.632 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.630+0000 7ff44ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.631+0000 7ff44ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.631+0000 7ff44ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.631+0000 7ff44ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.633 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44d59a640 1 -- 172.21.15.173:0/618435009 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131529366 0 0) 0x7ff4500a9ac0 con 0x7ff45013faa0 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44d59a640 10 monclient(hunting): _negotiate 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44d59a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44d59a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44d59a640 10 monclient(hunting): my global_id is 4150 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44d59a640 1 -- 172.21.15.173:0/618435009 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff438003520 con 0x7ff45013faa0 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 10 monclient(hunting): handle_auth_done global_id 4155 payload 274 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 1 -- 172.21.15.173:0/618435009 >> v1:172.21.15.173:6789/0 conn(0x7ff45013faa0 legacy=0x7ff450145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 1 -- 172.21.15.173:0/618435009 >> v1:172.21.15.116:6789/0 conn(0x7ff4500a96e0 legacy=0x7ff45013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 10 monclient: _finish_hunting 0 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 1 monclient: found mon.noname-a 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.634 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.633+0000 7ff44ed9d640 1 -- 172.21.15.173:0/618435009 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4500aae80 con 0x7ff4500b1850 2024-01-23T07:32:32.635 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.635+0000 7ff44ed9d640 1 --2- 172.21.15.173:0/618435009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff450145d10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff448009d90 tx=0x7ff44802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea55edadb59da2b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:32.636 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:32.637+0000 7f2773e12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-23T07:32:32.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 1 -- 172.21.15.173:0/618435009 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44802cd00 con 0x7ff4500b1850 2024-01-23T07:32:32.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.641 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: dump: 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: _finish_auth 0 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: _check_auth_tickets 2024-01-23T07:32:32.642 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 1 -- 172.21.15.173:0/618435009 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44802ce60 con 0x7ff4500b1850 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff454e99640 5 monclient: authenticate success, global_id 4155 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff454e99640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 1 -- 172.21.15.173:0/618435009 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448034660 con 0x7ff4500b1850 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff454e99640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff454e99640 4 set_mon_vals no callback set 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:32.643 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.641+0000 7ff44d59a640 10 monclient: dump: 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.644 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 10 monclient: shutdown 2024-01-23T07:32:32.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:32.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 1 -- 172.21.15.173:0/618435009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 msgr2=0x7ff450145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 1 --2- 172.21.15.173:0/618435009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff450145d10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff448009d90 tx=0x7ff44802bf50 comp rx=0 tx=0).stop 2024-01-23T07:32:32.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 1 -- 172.21.15.173:0/618435009 shutdown_connections 2024-01-23T07:32:32.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 1 --2- 172.21.15.173:0/618435009 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff450145d10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.648 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 1 -- 172.21.15.173:0/618435009 >> 172.21.15.173:0/618435009 conn(0x7ff4500b7bb0 msgr2=0x7ff4500b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 1 -- 172.21.15.173:0/618435009 shutdown_connections 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.642+0000 7ff454e99640 1 -- 172.21.15.173:0/618435009 wait complete. 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 10 monclient: build_initial_monmap 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 10 monclient: monmap: 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.649 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 1 librados: starting msgr at 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 1 librados: starting objecter 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 1 Processor -- start 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 1 -- start start 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 1 librados: setting wanted keys 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 1 librados: calling monclient init 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.643+0000 7ff454e99640 10 monclient: init 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4500a96e0 0x7ff45013ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): picked mon.noname-b con 0x7ff4500a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff4501daf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): picked mon.noname-a con 0x7ff4500b1850 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff45013faa0 0x7ff4501db450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): picked mon.noname-c con 0x7ff45013faa0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:32.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450141180 con 0x7ff4500b1850 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45013dcc0 con 0x7ff4500a96e0 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45013dfa0 con 0x7ff45013faa0 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff454e99640 10 monclient(hunting): authenticate will time out at 2345.887368s 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff44dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff4501daf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.644+0000 7ff44e59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4500a96e0 0x7ff45013ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44ed9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff45013faa0 0x7ff4501db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff4501daf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.173:55952/0 (socket says 172.21.15.173:55952) 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 1 -- 172.21.15.173:0/3695653219 learned_addr learned my addr 172.21.15.173:0/3695653219 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 10 monclient(hunting): get_auth_request con 0x7ff4500b1850 auth_method 0 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44e59c640 10 monclient(hunting): get_auth_request con 0x7ff4500a96e0 auth_method 0 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44e59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44e59c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44e59c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44ed9d640 10 monclient(hunting): get_auth_request con 0x7ff45013faa0 auth_method 0 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44ed9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44ed9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44ed9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44dd9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44e59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44e59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.652 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.645+0000 7ff44e59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.646+0000 7ff44ed9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.646+0000 7ff44ed9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.646+0000 7ff44ed9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 10 monclient(hunting): handle_auth_done global_id 4161 payload 824 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 1 -- 172.21.15.173:0/3695653219 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff45013faa0 msgr2=0x7ff4501db450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 1 --2- 172.21.15.173:0/3695653219 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff45013faa0 0x7ff4501db450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 1 -- 172.21.15.173:0/3695653219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4500a96e0 msgr2=0x7ff45013ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 1 --2- 172.21.15.173:0/3695653219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4500a96e0 0x7ff45013ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 10 monclient: _finish_hunting 0 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 1 monclient: found mon.noname-a 2024-01-23T07:32:32.653 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:32.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.654 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.648+0000 7ff44dd9b640 1 -- 172.21.15.173:0/3695653219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448009a70 con 0x7ff4500b1850 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.650+0000 7ff44dd9b640 1 --2- 172.21.15.173:0/3695653219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff4501daf10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff44400c400 tx=0x7ff44400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.650+0000 7ff43effd640 10 client.?.objecter ms_handle_connect 0x7ff4500b1850 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.650+0000 7ff43effd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 1 -- 172.21.15.173:0/3695653219 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4440074e0 con 0x7ff4500b1850 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: dump: 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.655 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: _finish_auth 0 2024-01-23T07:32:32.656 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: _check_auth_tickets 2024-01-23T07:32:32.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:32.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 1 -- 172.21.15.173:0/3695653219 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4440057a0 con 0x7ff4500b1850 2024-01-23T07:32:32.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:32.659 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 1 -- 172.21.15.173:0/3695653219 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444007660 con 0x7ff4500b1850 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 5 monclient: authenticate success, global_id 4161 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 10 monclient: _renew_subs 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45013ed50 con 0x7ff4500b1850 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff44cd99640 4 set_mon_vals no callback set 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff43effd640 10 monclient: dump: 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:32.661 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 10 client.4161.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 10 monclient: _renew_subs 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4501dbb70 con 0x7ff4500b1850 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 1 librados: init done 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.654+0000 7ff454e99640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.655+0000 7ff454e99640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.655+0000 7ff454e99640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.662 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.655+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff450067d70 con 0x7ff4500b1850 2024-01-23T07:32:32.693 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:32.693+0000 7f46d2254040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-23T07:32:32.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.757+0000 7ff43effd640 1 -- 172.21.15.173:0/3695653219 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff444005b50 con 0x7ff4500b1850 2024-01-23T07:32:32.761 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 1 -- 172.21.15.173:0/3695653219 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7ff44401b9a0 con 0x7ff4500b1850 2024-01-23T07:32:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 10 client.4161.objecter ms_dispatch 0x7ff450000b90 osd_map(8..8 src has 1..8) v4 2024-01-23T07:32:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 3 client.4161.objecter handle_osd_map got epochs [8,8] > 0 2024-01-23T07:32:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 3 client.4161.objecter handle_osd_map decoding full epoch 8 2024-01-23T07:32:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 20 client.4161.objecter dump_active .. 0 homeless 2024-01-23T07:32:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 1 -- 172.21.15.173:0/3695653219 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7ff444017070 con 0x7ff4500b1850 2024-01-23T07:32:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:32.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.761+0000 7ff43effd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:32.840 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:32.840+0000 7f46d2254040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-23T07:32:32.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.856+0000 7ff454e99640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "94e52b13-76ee-4bb4-b205-3cdcd0b70319", "id": 6}] 2024-01-23T07:32:32.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.856+0000 7ff454e99640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "94e52b13-76ee-4bb4-b205-3cdcd0b70319", "id": 6}] 2024-01-23T07:32:32.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.856+0000 7ff454e99640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:32.857 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.856+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94e52b13-76ee-4bb4-b205-3cdcd0b70319", "id": 6} v 0) v1 -- 0x7ff45004ea10 con 0x7ff4500b1850 2024-01-23T07:32:32.884 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:32.884+0000 7f46d2254040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-23T07:32:32.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.904+0000 7ff43effd640 1 -- 172.21.15.173:0/3695653219 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94e52b13-76ee-4bb4-b205-3cdcd0b70319", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff44401bc50 con 0x7ff4500b1850 2024-01-23T07:32:32.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.904+0000 7ff43effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "94e52b13-76ee-4bb4-b205-3cdcd0b70319", "id": 6}] 2024-01-23T07:32:32.904 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.904+0000 7ff43effd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:32.905 INFO:teuthology.orchestra.run.smithi173.stdout:6 2024-01-23T07:32:32.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 10 librados: watch_flush enter 2024-01-23T07:32:32.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 10 librados: watch_flush exit 2024-01-23T07:32:32.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 20 client.4161.objecter shutdown clearing up homeless session... 2024-01-23T07:32:32.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 10 client.4161.objecter successfully canceled tick 2024-01-23T07:32:32.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 10 monclient: shutdown 2024-01-23T07:32:32.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:32.906 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 msgr2=0x7ff4501daf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 --2- 172.21.15.173:0/3695653219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff4501daf10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff44400c400 tx=0x7ff44400c8c0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 shutdown_connections 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 --2- 172.21.15.173:0/3695653219 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff45013faa0 0x7ff4501db450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 --2- 172.21.15.173:0/3695653219 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff4500b1850 0x7ff4501daf10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 --2- 172.21.15.173:0/3695653219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4500a96e0 0x7ff45013ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 >> 172.21.15.173:0/3695653219 conn(0x7ff4500b7bb0 msgr2=0x7ff45013f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 shutdown_connections 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 -- 172.21.15.173:0/3695653219 wait complete. 2024-01-23T07:32:32.907 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:32.905+0000 7ff454e99640 1 librados: shutdown 2024-01-23T07:32:32.916 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 6dd94ed7-0c7a-495d-a5da-777bce3c00ae 7 2024-01-23T07:32:33.016 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.016+0000 7f87677c4640 10 monclient: get_monmap_and_config 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.016+0000 7f87677c4640 10 monclient: build_initial_monmap 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.016+0000 7f87677c4640 10 monclient: monmap: 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:32:33.017384+0000 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:32:33.017384+0000 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:33.017 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:33.018 INFO:teuthology.orchestra.run.smithi173.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:33.018 INFO:teuthology.orchestra.run.smithi173.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:33.018 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:33.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.016+0000 7f87677c4640 1 Processor -- start 2024-01-23T07:32:33.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 1 -- start start 2024-01-23T07:32:33.018 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient: init 2024-01-23T07:32:33.019 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f8760070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient(hunting): picked mon.noname-b con 0x7f87600b2e30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8760071570 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f876013ce70 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8760070180 con 0x7f8760071570 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8760072640 con 0x7f876013ce70 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600b3210 con 0x7f87600b2e30 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.017+0000 7f87677c4640 10 monclient(hunting): authenticate will time out at 2346.260808s 2024-01-23T07:32:33.020 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.018+0000 7f8765d61640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f876013ce70 0x7f876014a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.173:45434/0 (socket says 172.21.15.173:45434) 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.018+0000 7f8765d61640 1 -- 172.21.15.173:0/1677257767 learned_addr learned my addr 172.21.15.173:0/1677257767 (peer_addr_for_me v1:172.21.15.173:0/0) 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.018+0000 7f8765560640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f8760070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.018+0000 7f8765560640 10 monclient(hunting): get_auth_request con 0x7f87600b2e30 auth_method 0 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.018+0000 7f8765560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.018+0000 7f8765560640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.018+0000 7f8765560640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.019+0000 7f8765560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.019+0000 7f8765560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.021 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.019+0000 7f8765560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8757fff640 1 -- 172.21.15.173:0/1677257767 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91144131 0 0) 0x7f8760070180 con 0x7f8760071570 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8757fff640 10 monclient(hunting): _negotiate 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8757fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8757fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8757fff640 10 monclient(hunting): my global_id is 4164 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8757fff640 1 -- 172.21.15.173:0/1677257767 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f874c003520 con 0x7f8760071570 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 10 monclient(hunting): handle_auth_done global_id 14120 payload 274 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 1 -- 172.21.15.173:0/1677257767 >> v1:172.21.15.173:6789/0 conn(0x7f876013ce70 legacy=0x7f876014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 1 -- 172.21.15.173:0/1677257767 >> v1:172.21.15.116:6789/0 conn(0x7f8760071570 legacy=0x7f87601432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.023 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 10 monclient: _finish_hunting 0 2024-01-23T07:32:33.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 1 monclient: found mon.noname-b 2024-01-23T07:32:33.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:33.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.020+0000 7f8765560640 1 -- 172.21.15.173:0/1677257767 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760072920 con 0x7f87600b2e30 2024-01-23T07:32:33.024 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.022+0000 7f8765560640 1 --2- 172.21.15.173:0/1677257767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f8760070680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f875c0097d0 tx=0x7f875c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a3ce98aa11fbae0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 1 -- 172.21.15.173:0/1677257767 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c031770 con 0x7f87600b2e30 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: dump: 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.029 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: _finish_auth 0 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: _check_auth_tickets 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 1 -- 172.21.15.173:0/1677257767 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0318d0 con 0x7f87600b2e30 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 1 -- 172.21.15.173:0/1677257767 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c031c60 con 0x7f87600b2e30 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f87677c4640 5 monclient: authenticate success, global_id 14120 2024-01-23T07:32:33.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f87677c4640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f87677c4640 4 set_mon_vals no callback set 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f8757fff640 10 monclient: dump: 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:33.031 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f87677c4640 10 monclient: shutdown 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f87677c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f87677c4640 1 -- 172.21.15.173:0/1677257767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 msgr2=0x7f8760070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.028+0000 7f87677c4640 1 --2- 172.21.15.173:0/1677257767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f8760070680 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f875c0097d0 tx=0x7f875c02b810 comp rx=0 tx=0).stop 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.029+0000 7f87677c4640 1 -- 172.21.15.173:0/1677257767 shutdown_connections 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.029+0000 7f87677c4640 1 --2- 172.21.15.173:0/1677257767 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f8760070680 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.029+0000 7f87677c4640 1 -- 172.21.15.173:0/1677257767 >> 172.21.15.173:0/1677257767 conn(0x7f87600b5fe0 msgr2=0x7f87600b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.029+0000 7f87677c4640 1 -- 172.21.15.173:0/1677257767 shutdown_connections 2024-01-23T07:32:33.032 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.029+0000 7f87677c4640 1 -- 172.21.15.173:0/1677257767 wait complete. 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.029+0000 7f87677c4640 10 monclient: build_initial_monmap 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.029+0000 7f87677c4640 10 monclient: monmap: 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 0 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 0.000000 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:created 0.000000 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:33.036 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 librados: starting msgr at 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 librados: starting objecter 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 Processor -- start 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 -- start start 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 librados: setting wanted keys 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 librados: calling monclient init 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient: init 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f876006d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): picked mon.noname-c con 0x7f87600b2e30 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876013ce70 0x7f8760136040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.037 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): picked mon.noname-b con 0x7f876013ce70 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f876006d5c0 0x7f8760136580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): picked mon.noname-a con 0x7f876006d5c0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760137010 con 0x7f876006d5c0 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760136ac0 con 0x7f876013ce70 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8760141ff0 con 0x7f87600b2e30 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.030+0000 7f87677c4640 10 monclient(hunting): authenticate will time out at 2346.273761s 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8764d5f640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876013ce70 0x7f8760136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f876006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765d61640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f876006d5c0 0x7f8760136580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.038 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f876006d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.173:54280/0 (socket says 172.21.15.173:54280) 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 1 -- 172.21.15.173:0/271653313 learned_addr learned my addr 172.21.15.173:0/271653313 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 10 monclient(hunting): get_auth_request con 0x7f87600b2e30 auth_method 0 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8764d5f640 10 monclient(hunting): get_auth_request con 0x7f876013ce70 auth_method 0 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8764d5f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8764d5f640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8764d5f640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765d61640 10 monclient(hunting): get_auth_request con 0x7f876006d5c0 auth_method 0 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765d61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765d61640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765d61640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.039 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.031+0000 7f8765560640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.032+0000 7f8765560640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.032+0000 7f8765d61640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.032+0000 7f8765d61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.032+0000 7f8765d61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.032+0000 7f8764d5f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.032+0000 7f8764d5f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.032+0000 7f8764d5f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 10 monclient(hunting): handle_auth_done global_id 14123 payload 824 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 1 -- 172.21.15.173:0/271653313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876013ce70 msgr2=0x7f8760136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 1 --2- 172.21.15.173:0/271653313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876013ce70 0x7f8760136040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 1 -- 172.21.15.173:0/271653313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f876006d5c0 msgr2=0x7f8760136580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 1 --2- 172.21.15.173:0/271653313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f876006d5c0 0x7f8760136580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.040 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 10 monclient: _finish_hunting 0 2024-01-23T07:32:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 1 monclient: found mon.noname-c 2024-01-23T07:32:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.041 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.034+0000 7f8765560640 1 -- 172.21.15.173:0/271653313 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c009400 con 0x7f87600b2e30 2024-01-23T07:32:33.041 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:33.035+0000 7f46d2254040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-23T07:32:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.037+0000 7f8765560640 1 --2- 172.21.15.173:0/271653313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f876006d080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f875c0097d0 tx=0x7f875c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.037+0000 7f8755ffb640 10 client.?.objecter ms_handle_connect 0x7f87600b2e30 2024-01-23T07:32:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.037+0000 7f8755ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:33.042 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 1 -- 172.21.15.173:0/271653313 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c032810 con 0x7f87600b2e30 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: dump: 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.043 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: _finish_auth 0 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 1 -- 172.21.15.173:0/271653313 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c032990 con 0x7f87600b2e30 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 1 -- 172.21.15.173:0/271653313 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c032d40 con 0x7f87600b2e30 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8755ffb640 10 monclient: dump: 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:epoch 1 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.044 INFO:teuthology.orchestra.run.smithi173.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:election_strategy: 1 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 5 monclient: authenticate success, global_id 14123 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 10 monclient: _renew_subs 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f8756ffd640 4 set_mon_vals no callback set 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876006b7a0 con 0x7f87600b2e30 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 10 client.14123.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 10 monclient: _renew_subs 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.045 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87601d7830 con 0x7f87600b2e30 2024-01-23T07:32:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.040+0000 7f87677c4640 1 librados: init done 2024-01-23T07:32:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.041+0000 7f87677c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.041+0000 7f87677c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.041+0000 7f87677c4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.046 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.041+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8760067d50 con 0x7f87600b2e30 2024-01-23T07:32:33.111 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.111+0000 7f8755ffb640 1 -- 172.21.15.173:0/271653313 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f875c04e440 con 0x7f87600b2e30 2024-01-23T07:32:33.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.111+0000 7f8755ffb640 1 -- 172.21.15.173:0/271653313 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f875c03ba50 con 0x7f87600b2e30 2024-01-23T07:32:33.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.111+0000 7f8755ffb640 10 client.14123.objecter ms_dispatch 0x7f8760000b90 osd_map(9..9 src has 1..9) v4 2024-01-23T07:32:33.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.111+0000 7f8755ffb640 3 client.14123.objecter handle_osd_map got epochs [9,9] > 0 2024-01-23T07:32:33.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.111+0000 7f8755ffb640 3 client.14123.objecter handle_osd_map decoding full epoch 9 2024-01-23T07:32:33.112 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.111+0000 7f8755ffb640 20 client.14123.objecter dump_active .. 0 homeless 2024-01-23T07:32:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.237+0000 7f8755ffb640 1 -- 172.21.15.173:0/271653313 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f875c03b3f0 con 0x7f87600b2e30 2024-01-23T07:32:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.237+0000 7f8755ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:33.237 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.237+0000 7f8755ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:33.308 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.308+0000 7f87677c4640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "6dd94ed7-0c7a-495d-a5da-777bce3c00ae", "id": 7}] 2024-01-23T07:32:33.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.308+0000 7f87677c4640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "6dd94ed7-0c7a-495d-a5da-777bce3c00ae", "id": 7}] 2024-01-23T07:32:33.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.308+0000 7f87677c4640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.309 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.308+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6dd94ed7-0c7a-495d-a5da-777bce3c00ae", "id": 7} v 0) v1 -- 0x7f876004ea10 con 0x7f87600b2e30 2024-01-23T07:32:33.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.436+0000 7f8755ffb640 1 -- 172.21.15.173:0/271653313 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6dd94ed7-0c7a-495d-a5da-777bce3c00ae", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f875c03b720 con 0x7f87600b2e30 2024-01-23T07:32:33.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.436+0000 7f8755ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "6dd94ed7-0c7a-495d-a5da-777bce3c00ae", "id": 7}] 2024-01-23T07:32:33.436 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.436+0000 7f8755ffb640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:33.437 INFO:teuthology.orchestra.run.smithi173.stdout:7 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 10 librados: watch_flush enter 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 10 librados: watch_flush exit 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 20 client.14123.objecter shutdown clearing up homeless session... 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 10 client.14123.objecter successfully canceled tick 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 10 monclient: shutdown 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 msgr2=0x7f876006d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 --2- 172.21.15.173:0/271653313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f876006d080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f875c0097d0 tx=0x7f875c0046c0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 shutdown_connections 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 --2- 172.21.15.173:0/271653313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f876006d5c0 0x7f8760136580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 --2- 172.21.15.173:0/271653313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f876013ce70 0x7f8760136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.438 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 --2- 172.21.15.173:0/271653313 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f87600b2e30 0x7f876006d080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 >> 172.21.15.173:0/271653313 conn(0x7f87600b5fe0 msgr2=0x7f876013c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:33.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 shutdown_connections 2024-01-23T07:32:33.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 -- 172.21.15.173:0/271653313 wait complete. 2024-01-23T07:32:33.439 INFO:teuthology.orchestra.run.smithi173.stderr:2024-01-23T07:32:33.437+0000 7f87677c4640 1 librados: shutdown 2024-01-23T07:32:33.447 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.447 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-23T07:32:33.448 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2024-01-23T07:32:33.450 INFO:tasks.ceph.osd.0:Started 2024-01-23T07:32:33.450 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.450 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-23T07:32:33.450 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2024-01-23T07:32:33.452 INFO:tasks.ceph.osd.1:Started 2024-01-23T07:32:33.453 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.453 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-23T07:32:33.453 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2024-01-23T07:32:33.455 INFO:tasks.ceph.osd.2:Started 2024-01-23T07:32:33.455 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.455 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-23T07:32:33.455 DEBUG:teuthology.orchestra.run.smithi116:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2024-01-23T07:32:33.457 INFO:tasks.ceph.osd.3:Started 2024-01-23T07:32:33.457 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.457 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-23T07:32:33.458 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2024-01-23T07:32:33.459 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:33.459+0000 7f2773e12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-23T07:32:33.460 INFO:tasks.ceph.osd.4:Started 2024-01-23T07:32:33.460 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.460 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-23T07:32:33.460 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2024-01-23T07:32:33.462 INFO:tasks.ceph.osd.5:Started 2024-01-23T07:32:33.463 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.463 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-23T07:32:33.463 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2024-01-23T07:32:33.465 INFO:tasks.ceph.osd.6:Started 2024-01-23T07:32:33.465 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-01-23T07:32:33.465 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-23T07:32:33.465 DEBUG:teuthology.orchestra.run.smithi173:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2024-01-23T07:32:33.467 INFO:tasks.ceph.osd.7:Started 2024-01-23T07:32:33.468 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T07:32:33.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.621+0000 7f6811245640 10 monclient: get_monmap_and_config 2024-01-23T07:32:33.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.621+0000 7f6811245640 10 monclient: build_initial_monmap 2024-01-23T07:32:33.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.621+0000 7f6811245640 10 monclient: monmap: 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:32:33.622244+0000 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:32:33.622244+0000 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:33.622 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.622+0000 7f6811245640 1 Processor -- start 2024-01-23T07:32:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.622+0000 7f6811245640 1 -- start start 2024-01-23T07:32:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.622+0000 7f6811245640 10 monclient: init 2024-01-23T07:32:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2024-01-23T07:32:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f680c0a96e0 0x7f680c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 10 monclient(hunting): picked mon.noname-a con 0x7f680c0a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c13f390 0x7f680c13f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 10 monclient(hunting): picked mon.noname-b con 0x7f680c13f390 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f680c145600 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0aac10 con 0x7f680c145600 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0a9e00 con 0x7f680c0a96e0 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.623+0000 7f6811245640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6811245640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c13fd30 con 0x7f680c13f390 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6811245640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6803fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c13f390 0x7f680c13f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f680ad9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f680c0a96e0 0x7f680c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f680b59e640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f680c145600 0x7f680c145a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:55316/0 (socket says 172.21.15.116:55316) 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f680b59e640 1 -- 172.21.15.116:0/2020554257 learned_addr learned my addr 172.21.15.116:0/2020554257 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:32:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6811245640 10 monclient(hunting): authenticate will time out at 2360.982535s 2024-01-23T07:32:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6803fff640 10 monclient(hunting): get_auth_request con 0x7f680c13f390 auth_method 0 2024-01-23T07:32:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6803fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6803fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.624+0000 7f6803fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.625+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.625+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.625+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.626+0000 7f680ad9d640 10 monclient(hunting): get_auth_request con 0x7f680c0a96e0 auth_method 0 2024-01-23T07:32:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.626+0000 7f680ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.626+0000 7f680ad9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.626+0000 7f680ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.627+0000 7f680ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.627+0000 7f680ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.627+0000 7f680ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.627+0000 7f6803fff640 10 monclient(hunting): handle_auth_done global_id 14126 payload 274 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.627+0000 7f6803fff640 1 -- 172.21.15.116:0/2020554257 >> v2:172.21.15.116:3300/0 conn(0x7f680c0a96e0 msgr2=0x7f680c0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.627+0000 7f6803fff640 1 --2- 172.21.15.116:0/2020554257 >> v2:172.21.15.116:3300/0 conn(0x7f680c0a96e0 0x7f680c0b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.628+0000 7f6803fff640 1 -- 172.21.15.116:0/2020554257 >> v1:172.21.15.116:6789/0 conn(0x7f680c145600 legacy=0x7f680c145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.628+0000 7f6803fff640 10 monclient: _finish_hunting 0 2024-01-23T07:32:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.628+0000 7f6803fff640 1 monclient: found mon.noname-b 2024-01-23T07:32:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.628+0000 7f6803fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.628+0000 7f6803fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.628+0000 7f6803fff640 1 -- 172.21.15.116:0/2020554257 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0a9ac0 con 0x7f680c13f390 2024-01-23T07:32:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.631+0000 7f6803fff640 1 --2- 172.21.15.116:0/2020554257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c13f390 0x7f680c13f7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009790 tx=0x7f67f402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f43bb2c725ca48e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:33.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 1 -- 172.21.15.116:0/2020554257 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4031640 con 0x7f680c13f390 2024-01-23T07:32:33.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:33.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 10 monclient: dump: 2024-01-23T07:32:33.639 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 10 monclient: _finish_auth 0 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 10 monclient: _check_auth_tickets 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 1 -- 172.21.15.116:0/2020554257 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f40317a0 con 0x7f680c13f390 2024-01-23T07:32:33.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f6811245640 5 monclient: authenticate success, global_id 14126 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f6811245640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f6811245640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f6811245640 4 set_mon_vals no callback set 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 1 -- 172.21.15.116:0/2020554257 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4031b70 con 0x7f680c13f390 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.637+0000 7f680a59c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f680a59c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f680a59c640 10 monclient: dump: 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.641 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 10 monclient: shutdown 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 1 -- 172.21.15.116:0/2020554257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c13f390 msgr2=0x7f680c13f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 1 --2- 172.21.15.116:0/2020554257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c13f390 0x7f680c13f7f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009790 tx=0x7f67f402b8f0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 1 -- 172.21.15.116:0/2020554257 shutdown_connections 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 1 --2- 172.21.15.116:0/2020554257 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c13f390 0x7f680c13f7f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 1 --2- 172.21.15.116:0/2020554257 >> v2:172.21.15.116:3300/0 conn(0x7f680c0a96e0 0x7f680c0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.638+0000 7f6811245640 1 -- 172.21.15.116:0/2020554257 >> 172.21.15.116:0/2020554257 conn(0x7f680c0b7bb0 msgr2=0x7f680c0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.639+0000 7f6811245640 1 -- 172.21.15.116:0/2020554257 shutdown_connections 2024-01-23T07:32:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.639+0000 7f6811245640 1 -- 172.21.15.116:0/2020554257 wait complete. 2024-01-23T07:32:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 10 monclient: build_initial_monmap 2024-01-23T07:32:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 10 monclient: monmap: 2024-01-23T07:32:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:32:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 1 librados: starting msgr at 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 1 librados: starting objecter 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 1 Processor -- start 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 1 -- start start 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 1 librados: setting wanted keys 2024-01-23T07:32:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 1 librados: calling monclient init 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.640+0000 7f6811245640 10 monclient: init 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.641+0000 7f6811245640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.641+0000 7f6811245640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.641+0000 7f6811245640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c0a96e0 0x7f680c1448d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.641+0000 7f6811245640 10 monclient(hunting): picked mon.noname-c con 0x7f680c0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.641+0000 7f6811245640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c13f390 0x7f680c1360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.641+0000 7f6811245640 10 monclient(hunting): picked mon.noname-a con 0x7f680c13f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.641+0000 7f6811245640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f680c145600 0x7f680c1dbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 10 monclient(hunting): picked mon.noname-b con 0x7f680c145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0b7030 con 0x7f680c13f390 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f680ad9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c0a96e0 0x7f680c1448d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c137b90 con 0x7f680c145600 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c136620 con 0x7f680c0a96e0 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f6811245640 10 monclient(hunting): authenticate will time out at 2361.000742s 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f680ad9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c0a96e0 0x7f680c1448d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:59994/0 (socket says 172.21.15.116:59994) 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f680ad9d640 1 -- 172.21.15.116:0/131796286 learned_addr learned my addr 172.21.15.116:0/131796286 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f680ad9d640 10 monclient(hunting): get_auth_request con 0x7f680c0a96e0 auth_method 0 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f680ad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f680ad9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.642+0000 7f680ad9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f6803fff640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c13f390 0x7f680c1360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680b59e640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f680c145600 0x7f680c1dbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680ad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680ad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680ad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f6803fff640 10 monclient(hunting): get_auth_request con 0x7f680c13f390 auth_method 0 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f6803fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f6803fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f6803fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680b59e640 10 monclient(hunting): get_auth_request con 0x7f680c145600 auth_method 0 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680b59e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680b59e640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.643+0000 7f680b59e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.644+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.644+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.644+0000 7f6803fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.644+0000 7f680b59e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.644+0000 7f680b59e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.644+0000 7f680b59e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 10 monclient(hunting): handle_auth_done global_id 14129 payload 824 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 1 -- 172.21.15.116:0/131796286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f680c145600 msgr2=0x7f680c1dbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f680c145600 0x7f680c1dbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 1 -- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c13f390 msgr2=0x7f680c1360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c13f390 0x7f680c1360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 10 monclient: _finish_hunting 0 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 1 monclient: found mon.noname-c 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.647+0000 7f680ad9d640 1 -- 172.21.15.116:0/131796286 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f40093a0 con 0x7f680c0a96e0 2024-01-23T07:32:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.650+0000 7f680ad9d640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c0a96e0 0x7f680c1448d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00e9b0 tx=0x7f67fc00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.651+0000 7f68037fe640 10 client.?.objecter ms_handle_connect 0x7f680c0a96e0 2024-01-23T07:32:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.651+0000 7f68037fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 1 -- 172.21.15.116:0/131796286 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc009670 con 0x7f680c0a96e0 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: dump: 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:33.659 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: _finish_auth 0 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: _check_auth_tickets 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 1 -- 172.21.15.116:0/131796286 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc00c9a0 con 0x7f680c0a96e0 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 1 -- 172.21.15.116:0/131796286 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc00cd50 con 0x7f680c0a96e0 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f68037fe640 10 monclient: dump: 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:32:33.660 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.656+0000 7f6809d9b640 4 set_mon_vals no callback set 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 5 monclient: authenticate success, global_id 14129 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 10 monclient: _renew_subs 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c0b7240 con 0x7f680c0a96e0 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 10 client.14129.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 10 monclient: _renew_subs 2024-01-23T07:32:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c1dc190 con 0x7f680c0a96e0 2024-01-23T07:32:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.657+0000 7f6811245640 1 librados: init done 2024-01-23T07:32:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.658+0000 7f6811245640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.658+0000 7f6811245640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.658+0000 7f6811245640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.658+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c067d70 con 0x7f680c0a96e0 2024-01-23T07:32:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.664+0000 7f68037fe640 1 -- 172.21.15.116:0/131796286 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f67fc005990 con 0x7f680c0a96e0 2024-01-23T07:32:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.664+0000 7f68037fe640 1 -- 172.21.15.116:0/131796286 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f67fc013b40 con 0x7f680c0a96e0 2024-01-23T07:32:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.664+0000 7f68037fe640 10 client.14129.objecter ms_dispatch 0x7f680c000b90 osd_map(10..10 src has 1..10) v4 2024-01-23T07:32:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.664+0000 7f68037fe640 3 client.14129.objecter handle_osd_map got epochs [10,10] > 0 2024-01-23T07:32:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.664+0000 7f68037fe640 3 client.14129.objecter handle_osd_map decoding full epoch 10 2024-01-23T07:32:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.664+0000 7f68037fe640 20 client.14129.objecter dump_active .. 0 homeless 2024-01-23T07:32:33.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.842+0000 7f68037fe640 1 -- 172.21.15.116:0/131796286 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f67fc021060 con 0x7f680c0a96e0 2024-01-23T07:32:33.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.842+0000 7f68037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:33.843 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.842+0000 7f68037fe640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:33.889 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:33.888+0000 7f2773e12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-23T07:32:33.962 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:33.962+0000 7f2773e12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-23T07:32:33.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.964+0000 7f6811245640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:33.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.964+0000 7f6811245640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:33.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.964+0000 7f6811245640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:32:33.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:33.964+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f680c04ea10 con 0x7f680c0a96e0 2024-01-23T07:32:34.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.039+0000 7f68037fe640 1 -- 172.21.15.116:0/131796286 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f67fc017070 con 0x7f680c0a96e0 2024-01-23T07:32:34.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.039+0000 7f68037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:34.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.039+0000 7f68037fe640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:34.039 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:32:34.040 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":10,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:32:33.359618+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 10 librados: watch_flush enter 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 10 librados: watch_flush exit 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 20 client.14129.objecter shutdown clearing up homeless session... 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 10 client.14129.objecter successfully canceled tick 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 10 monclient: shutdown 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c0a96e0 msgr2=0x7f680c1448d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c0a96e0 0x7f680c1448d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f67fc00e9b0 tx=0x7f67fc00ee70 comp rx=0 tx=0).stop 2024-01-23T07:32:34.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 shutdown_connections 2024-01-23T07:32:34.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f680c145600 0x7f680c1dbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:34.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f680c13f390 0x7f680c1360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:34.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 --2- 172.21.15.116:0/131796286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f680c0a96e0 0x7f680c1448d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:34.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 >> 172.21.15.116:0/131796286 conn(0x7f680c0b7bb0 msgr2=0x7f680c134c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:34.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 shutdown_connections 2024-01-23T07:32:34.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 -- 172.21.15.116:0/131796286 wait complete. 2024-01-23T07:32:34.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:32:34.040+0000 7f6811245640 1 librados: shutdown 2024-01-23T07:32:34.050 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:34.050+0000 7f46d2254040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-23T07:32:34.056 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-23T07:32:34.057 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-23T07:32:34.079 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:34.079+0000 7f2773e12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-23T07:32:34.530 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:34.530+0000 7f46d2254040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-23T07:32:34.621 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:34.621+0000 7f46d2254040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-23T07:32:34.809 INFO:tasks.ceph.mgr.x.smithi173.stderr:2024-01-23T07:32:34.808+0000 7f46d2254040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-23T07:32:34.863 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:32:35.010 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.009+0000 7f0911b42640 10 monclient: get_monmap_and_config 2024-01-23T07:32:35.010 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.009+0000 7f0911b42640 10 monclient: build_initial_monmap 2024-01-23T07:32:35.010 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.010+0000 7f0911b42640 10 monclient: monmap: 2024-01-23T07:32:35.010 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:35.010 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:32:35.011173+0000 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:32:35.011173+0000 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:35.011 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:35.012 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.011+0000 7f0911b42640 1 Processor -- start 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.011+0000 7f0911b42640 1 -- start start 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.011+0000 7f0911b42640 10 monclient: init 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.011+0000 7f0911b42640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.011+0000 7f0911b42640 10 monclient: _add_conns ranks=[3,0,1,2,4] 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f090c06c3a0 0x7f090c13f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 10 monclient(hunting): picked mon.noname-a con 0x7f090c06c3a0 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f090c0a9e50 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f090c13f8b0 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c0aaef0 con 0x7f090c0a9e50 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c0ab1d0 con 0x7f090c13f8b0 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c13fd40 con 0x7f090c06c3a0 2024-01-23T07:32:35.013 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:35.014 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.012+0000 7f0911b42640 10 monclient(hunting): authenticate will time out at 2362.370492s 2024-01-23T07:32:35.014 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.013+0000 7f090bfff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f090c13f8b0 0x7f090c14c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:60248/0 (socket says 172.21.15.116:60248) 2024-01-23T07:32:35.014 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.013+0000 7f090bfff640 1 -- 172.21.15.116:0/2309480103 learned_addr learned my addr 172.21.15.116:0/2309480103 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:32:35.106 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.105+0000 7f090b7fe640 1 --2- 172.21.15.116:0/2309480103 >> v2:172.21.15.116:3300/0 conn(0x7f090c06c3a0 0x7f090c13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:35.107 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.107+0000 7f090b7fe640 10 monclient(hunting): get_auth_request con 0x7f090c06c3a0 auth_method 0 2024-01-23T07:32:35.107 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.107+0000 7f090b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:35.107 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.107+0000 7f090b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:35.107 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.107+0000 7f090b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:35.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.110+0000 7f090b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:35.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.110+0000 7f090b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:35.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.110+0000 7f090b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 10 monclient(hunting): handle_auth_done global_id 4188 payload 274 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 1 -- 172.21.15.116:0/2309480103 >> v1:172.21.15.173:6789/0 conn(0x7f090c13f8b0 legacy=0x7f090c14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 1 -- 172.21.15.116:0/2309480103 >> v1:172.21.15.116:6789/0 conn(0x7f090c0a9e50 legacy=0x7f090c142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 1 monclient: found mon.noname-a 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:35.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.112+0000 7f090b7fe640 1 -- 172.21.15.116:0/2309480103 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c0b3d60 con 0x7f090c06c3a0 2024-01-23T07:32:35.126 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.126+0000 7f090b7fe640 1 --2- 172.21.15.116:0/2309480103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c06c3a0 0x7f090c13f370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0097d0 tx=0x7f08fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f3b704b71cdfe8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:35.286 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 1 -- 172.21.15.116:0/2309480103 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc02e070 con 0x7f090c06c3a0 2024-01-23T07:32:35.286 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:35.286 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: dump: 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: _finish_auth 0 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:32:35.287 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 1 -- 172.21.15.116:0/2309480103 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc0315a0 con 0x7f090c06c3a0 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 1 -- 172.21.15.116:0/2309480103 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc031930 con 0x7f090c06c3a0 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f090a7fc640 10 monclient: dump: 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:35.288 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:35.289 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:35.289 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:35.289 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:35.289 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f0911b42640 5 monclient: authenticate success, global_id 4188 2024-01-23T07:32:35.289 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f0911b42640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:35.289 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.286+0000 7f0911b42640 4 set_mon_vals no callback set 2024-01-23T07:32:35.292 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 10 monclient: shutdown 2024-01-23T07:32:35.292 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:35.292 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 1 -- 172.21.15.116:0/2309480103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c06c3a0 msgr2=0x7f090c13f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:35.292 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 1 --2- 172.21.15.116:0/2309480103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c06c3a0 0x7f090c13f370 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0097d0 tx=0x7f08fc02b840 comp rx=0 tx=0).stop 2024-01-23T07:32:35.292 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 1 -- 172.21.15.116:0/2309480103 shutdown_connections 2024-01-23T07:32:35.292 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 1 --2- 172.21.15.116:0/2309480103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c06c3a0 0x7f090c13f370 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:35.292 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 1 -- 172.21.15.116:0/2309480103 >> 172.21.15.116:0/2309480103 conn(0x7f090c0b7c20 msgr2=0x7f090c0b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 1 -- 172.21.15.116:0/2309480103 shutdown_connections 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.287+0000 7f0911b42640 1 -- 172.21.15.116:0/2309480103 wait complete. 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.288+0000 7f0911b42640 10 monclient: build_initial_monmap 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.288+0000 7f0911b42640 10 monclient: monmap: 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:35.293 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.288+0000 7f0911b42640 1 librados: starting msgr at 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.288+0000 7f0911b42640 1 librados: starting objecter 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.289+0000 7f0911b42640 1 Processor -- start 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.289+0000 7f0911b42640 1 -- start start 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.289+0000 7f0911b42640 1 librados: setting wanted keys 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.289+0000 7f0911b42640 1 librados: calling monclient init 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.289+0000 7f0911b42640 10 monclient: init 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:35.294 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f090c06c3a0 0x7f090c1cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 10 monclient(hunting): picked mon.noname-b con 0x7f090c06c3a0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c0a9e50 0x7f090c1cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 10 monclient(hunting): picked mon.noname-a con 0x7f090c0a9e50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f090c13f8b0 0x7f090c1ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.290+0000 7f0911b42640 10 monclient(hunting): picked mon.noname-c con 0x7f090c13f8b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1cce20 con 0x7f090c0a9e50 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1cbe30 con 0x7f090c06c3a0 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:35.295 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c1cbb30 con 0x7f090c13f8b0 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f0911b42640 10 monclient(hunting): authenticate will time out at 2362.649338s 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.291+0000 7f090b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f090c06c3a0 0x7f090c1cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f090c06c3a0 0x7f090c1cb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:43340/0 (socket says 172.21.15.116:43340) 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 1 -- 172.21.15.116:0/1710903648 learned_addr learned my addr 172.21.15.116:0/1710903648 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 10 monclient(hunting): get_auth_request con 0x7f090c06c3a0 auth_method 0 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:35.296 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:35.297 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:35.297 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.292+0000 7f090b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.293+0000 7f090bfff640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f090c13f8b0 0x7f090c1ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.294+0000 7f090bfff640 10 monclient(hunting): get_auth_request con 0x7f090c13f8b0 auth_method 0 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.294+0000 7f090bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.294+0000 7f090bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.294+0000 7f090bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.294+0000 7f090bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.294+0000 7f090bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.295+0000 7f090bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.296+0000 7f090b7fe640 10 monclient(hunting): handle_auth_done global_id 4165 payload 824 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 1 -- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f090c13f8b0 msgr2=0x7f090c1ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:35.298 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f090c13f8b0 0x7f090c1ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:35.299 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 1 -- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c0a9e50 msgr2=0x7f090c1cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:35.299 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c0a9e50 0x7f090c1cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:35.299 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:32:35.299 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 1 monclient: found mon.noname-b 2024-01-23T07:32:35.299 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:35.299 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:32:35.299 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.297+0000 7f090b7fe640 1 -- 172.21.15.116:0/1710903648 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc009400 con 0x7f090c06c3a0 2024-01-23T07:32:35.300 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.300+0000 7f090b7fe640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f090c06c3a0 0x7f090c1cb5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0098f0 tx=0x7f08fc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:35.300 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.300+0000 7f08f3fff640 10 client.?.objecter ms_handle_connect 0x7f090c06c3a0 2024-01-23T07:32:35.300 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.300+0000 7f08f3fff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:35.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc032900 con 0x7f090c06c3a0 2024-01-23T07:32:35.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:35.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:35.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: dump: 2024-01-23T07:32:35.306 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: _finish_auth 0 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: _check_auth_tickets 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08fc032aa0 con 0x7f090c06c3a0 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:35.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc032e50 con 0x7f090c06c3a0 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f08f3fff640 10 monclient: dump: 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:35.308 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:35.309 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0909ffb640 4 set_mon_vals no callback set 2024-01-23T07:32:35.309 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 5 monclient: authenticate success, global_id 4165 2024-01-23T07:32:35.309 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 10 monclient: _renew_subs 2024-01-23T07:32:35.309 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:35.309 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c1cd020 con 0x7f090c06c3a0 2024-01-23T07:32:35.309 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 10 client.4165.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 10 monclient: _renew_subs 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c1cd5e0 con 0x7f090c06c3a0 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.306+0000 7f0911b42640 1 librados: init done 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.308+0000 7f0911b42640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.308+0000 7f0911b42640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.308+0000 7f0911b42640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:35.310 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.308+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c146450 con 0x7f090c06c3a0 2024-01-23T07:32:35.496 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.496+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 2) v1 ==== 44628+0+0 (secure 0 0 0) 0x7f08fc0453f0 con 0x7f090c06c3a0 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.506+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f08fc04d560 con 0x7f090c06c3a0 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.506+0000 7f08f3fff640 10 client.4165.objecter ms_dispatch 0x7f090c000b90 osd_map(10..10 src has 1..10) v4 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.506+0000 7f08f3fff640 3 client.4165.objecter handle_osd_map got epochs [10,10] > 0 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.506+0000 7f08f3fff640 3 client.4165.objecter handle_osd_map decoding full epoch 10 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.506+0000 7f08f3fff640 20 client.4165.objecter dump_active .. 0 homeless 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.506+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f08fc04c900 con 0x7f090c06c3a0 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.507+0000 7f08f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:35.507 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.507+0000 7f08f3fff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:35.628 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.628+0000 7f0911b42640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:35.629 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.628+0000 7f0911b42640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:35.629 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.628+0000 7f0911b42640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:35.629 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:35.628+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f090c075e50 con 0x7f090c06c3a0 2024-01-23T07:32:36.018 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.017+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mgrmap(e 3) v1 ==== 89044+0+0 (secure 0 0 0) 0x7f08fc03b3f0 con 0x7f090c06c3a0 2024-01-23T07:32:36.018 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.018+0000 7f08f3fff640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f08f806cf80 0x7f08f806f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:36.018 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.018+0000 7f090affd640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f08f806cf80 0x7f08f806f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:36.018 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.018+0000 7f090affd640 10 monclient: get_auth_request con 0x7f08f806cf80 auth_method 0 2024-01-23T07:32:36.019 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.018+0000 7f090affd640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f08f806cf80 0x7f08f806f370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f090c138f20 tx=0x7f0900007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:36.019 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.018+0000 7f08f3fff640 10 client.4165.objecter ms_handle_connect 0x7f08f806cf80 2024-01-23T07:32:36.110 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.109+0000 7f08f3fff640 1 -- 172.21.15.116:0/1710903648 <== mon.1 v2:172.21.15.173:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f08fc065100 con 0x7f090c06c3a0 2024-01-23T07:32:36.110 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.109+0000 7f08f3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:36.110 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.109+0000 7f08f3fff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:36.110 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:32:36.110 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:32:33.359618+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 10 librados: watch_flush enter 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 10 librados: watch_flush exit 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 20 client.4165.objecter shutdown clearing up homeless session... 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 10 client.4165.objecter successfully canceled tick 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f08f806cf80 msgr2=0x7f08f806f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f08f806cf80 0x7f08f806f370 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f090c138f20 tx=0x7f0900007990 comp rx=0 tx=0).stop 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 10 monclient: shutdown 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f090c06c3a0 msgr2=0x7f090c1cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f090c06c3a0 0x7f090c1cb5f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0098f0 tx=0x7f08fc0046c0 comp rx=0 tx=0).stop 2024-01-23T07:32:36.112 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 shutdown_connections 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f08f806cf80 0x7f08f806f370 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f090c13f8b0 0x7f090c1ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f090c0a9e50 0x7f090c1cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 --2- 172.21.15.116:0/1710903648 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f090c06c3a0 0x7f090c1cb5f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 >> 172.21.15.116:0/1710903648 conn(0x7f090c0b7c20 msgr2=0x7f090c0b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 shutdown_connections 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 -- 172.21.15.116:0/1710903648 wait complete. 2024-01-23T07:32:36.113 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:36.111+0000 7f0911b42640 1 librados: shutdown 2024-01-23T07:32:36.127 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-23T07:32:36.175 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:36.174+0000 7f2714b88640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-23T07:32:36.335 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T07:32:36.335+0000 7f2714b88640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-23T07:32:40.947 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:07.419 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:40.954 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:07.430 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.023 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:07.495 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.028 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:07.504 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.032 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:07.504 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.094 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:07.566 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.196 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:07.671 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.211 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:07.678 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.263 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:07.738 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.273 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:07.740 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.372 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:07.834 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.439 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:07.902 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.505 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:07.964 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.566 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:08.025 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.578 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:32:41.572+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:41.587 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:32:41.581+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:41.615 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:08.091 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.653 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:32:41.647+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:41.675 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:08.149 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:41.821 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T07:32:41.815+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:41.833 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:32:41.827+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:42.009 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:32:42.003+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:42.013 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:08.486 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.055 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:08.531 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.126 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:08.598 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.135 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:32:42.129+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:42.252 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:32:42.245+0000 5dc2480 -1 Falling back to public interface 2024-01-23T07:32:42.301 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:08.769 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.314 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:08.789 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.381 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:08.853 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.427 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:08.903 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.493 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:08.965 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.511 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:08.973 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.603 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:09.061 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.665 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:09.133 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.696 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.166 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.696 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:09.169 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.731 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:09.206 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.780 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:09.256 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.806 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:09.279 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.886 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:09.348 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.931 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:32:42.958 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.430 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.969 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:09.427 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:42.993 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:09.460 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.011 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:09.486 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.018+0000 7f7321f05640 10 monclient: get_monmap_and_config 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.018+0000 7f7321f05640 10 monclient: build_initial_monmap 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.019+0000 7f7321f05640 10 monclient: monmap: 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:32:43.020185+0000 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:32:43.020185+0000 2024-01-23T07:32:43.019 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:43.020 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:43.020 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:43.020 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:43.020 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:43.020 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:43.020 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:43.020 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.019+0000 7f7321f05640 1 Processor -- start 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.019+0000 7f7321f05640 1 -- start start 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.019+0000 7f7321f05640 10 monclient: init 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient: _add_conns ranks=[2,1,3,0,4] 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c06bb50 0x7f731c0b0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient(hunting): picked mon.noname-b con 0x7f731c06bb50 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f731c0af7f0 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f731c0b0960 0x7f731c146330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:43.022 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient(hunting): picked mon.noname-a con 0x7f731c0b0960 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c0adb20 con 0x7f731c0af7f0 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c06c270 con 0x7f731c0b0960 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c06bf30 con 0x7f731c06bb50 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.020+0000 7f7321f05640 10 monclient(hunting): authenticate will time out at 2370.378693s 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f731c0b0960 0x7f731c146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c06bb50 0x7f731c0b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f7312ffd640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f731c0af7f0 0x7f731c145c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:56466/0 (socket says 172.21.15.116:56466) 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f7312ffd640 1 -- 172.21.15.116:0/2287785709 learned_addr learned my addr 172.21.15.116:0/2287785709 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 10 monclient(hunting): get_auth_request con 0x7f731c0b0960 auth_method 0 2024-01-23T07:32:43.023 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 10 monclient(hunting): get_auth_request con 0x7f731c06bb50 auth_method 0 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:43.024 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.021+0000 7f731bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 10 monclient(hunting): handle_auth_done global_id 14165 payload 274 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 1 -- 172.21.15.116:0/2287785709 >> v2:172.21.15.116:3300/0 conn(0x7f731c0b0960 msgr2=0x7f731c146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 1 --2- 172.21.15.116:0/2287785709 >> v2:172.21.15.116:3300/0 conn(0x7f731c0b0960 0x7f731c146330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 1 -- 172.21.15.116:0/2287785709 >> v1:172.21.15.173:6789/0 conn(0x7f731c0af7f0 legacy=0x7f731c145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 1 monclient: found mon.noname-b 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:32:43.025 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731b7fe640 1 -- 172.21.15.116:0/2287785709 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0add70 con 0x7f731c06bb50 2024-01-23T07:32:43.026 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.023+0000 7f731bfff640 1 --2- 172.21.15.116:0/2287785709 >> v2:172.21.15.116:3300/0 conn(0x7f731c0b0960 0x7f731c146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T07:32:43.026 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.025+0000 7f731b7fe640 1 --2- 172.21.15.116:0/2287785709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c06bb50 0x7f731c0b0420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f730c0097a0 tx=0x7f730c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adaae7e5a814382b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:43.028 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f731affd640 1 -- 172.21.15.116:0/2287785709 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c031830 con 0x7f731c06bb50 2024-01-23T07:32:43.028 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f731affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:43.028 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f731affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:43.028 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f731affd640 10 monclient: dump: 2024-01-23T07:32:43.028 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:43.028 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f731affd640 10 monclient: _finish_auth 0 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f731affd640 10 monclient: _check_auth_tickets 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f731affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f7321f05640 5 monclient: authenticate success, global_id 14165 2024-01-23T07:32:43.029 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.028+0000 7f7321f05640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f731affd640 1 -- 172.21.15.116:0/2287785709 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c031990 con 0x7f731c06bb50 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f731affd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f731affd640 1 -- 172.21.15.116:0/2287785709 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c031d20 con 0x7f731c06bb50 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 4 set_mon_vals no callback set 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f731affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f731affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:32:43.030 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f731affd640 10 monclient: dump: 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:43.031 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:43.034 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 10 monclient: shutdown 2024-01-23T07:32:43.034 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:43.034 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 1 -- 172.21.15.116:0/2287785709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c06bb50 msgr2=0x7f731c0b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:43.034 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 1 --2- 172.21.15.116:0/2287785709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c06bb50 0x7f731c0b0420 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f730c0097a0 tx=0x7f730c02b8d0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.034 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 1 -- 172.21.15.116:0/2287785709 shutdown_connections 2024-01-23T07:32:43.034 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 1 --2- 172.21.15.116:0/2287785709 >> v2:172.21.15.116:3300/0 conn(0x7f731c0b0960 0x7f731c146330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 1 --2- 172.21.15.116:0/2287785709 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c06bb50 0x7f731c0b0420 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.030+0000 7f7321f05640 1 -- 172.21.15.116:0/2287785709 >> 172.21.15.116:0/2287785709 conn(0x7f731c066eb0 msgr2=0x7f731c0b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.031+0000 7f7321f05640 1 -- 172.21.15.116:0/2287785709 shutdown_connections 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.031+0000 7f7321f05640 1 -- 172.21.15.116:0/2287785709 wait complete. 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.031+0000 7f7321f05640 10 monclient: build_initial_monmap 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.031+0000 7f7321f05640 10 monclient: monmap: 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:43.035 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.031+0000 7f7321f05640 1 librados: starting msgr at 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.031+0000 7f7321f05640 1 librados: starting objecter 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 Processor -- start 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 -- start start 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 librados: setting wanted keys 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 librados: calling monclient init 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient: init 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f731c06bb50 0x7f731c146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:43.036 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): picked mon.noname-a con 0x7f731c06bb50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c0af7f0 0x7f731c147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): picked mon.noname-c con 0x7f731c0af7f0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c0b0960 0x7f731c1d77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): picked mon.noname-b con 0x7f731c0b0960 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c1d7360 con 0x7f731c06bb50 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c148f20 con 0x7f731c0b0960 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c13da10 con 0x7f731c0af7f0 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.032+0000 7f7321f05640 10 monclient(hunting): authenticate will time out at 2370.390993s 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c0b0960 0x7f731c1d77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:43.037 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731b7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f731c06bb50 0x7f731c146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:43.038 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c0b0960 0x7f731c1d77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:33904/0 (socket says 172.21.15.116:33904) 2024-01-23T07:32:43.038 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731bfff640 1 -- 172.21.15.116:0/1015545613 learned_addr learned my addr 172.21.15.116:0/1015545613 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:43.038 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731bfff640 10 monclient(hunting): get_auth_request con 0x7f731c0b0960 auth_method 0 2024-01-23T07:32:43.038 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:43.038 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:43.039 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:43.039 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731b7fe640 10 monclient(hunting): get_auth_request con 0x7f731c06bb50 auth_method 0 2024-01-23T07:32:43.039 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:43.039 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:43.039 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.033+0000 7f731b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:43.040 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.034+0000 7f7312ffd640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c0af7f0 0x7f731c147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:43.040 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.034+0000 7f731bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:43.040 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.034+0000 7f731bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:43.040 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.034+0000 7f731bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:43.040 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.034+0000 7f731b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:43.040 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.034+0000 7f731b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:43.040 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.034+0000 7f731b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:43.041 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.035+0000 7f7312ffd640 10 monclient(hunting): get_auth_request con 0x7f731c0af7f0 auth_method 0 2024-01-23T07:32:43.041 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.035+0000 7f7312ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:43.041 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.035+0000 7f7312ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.035+0000 7f7312ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.035+0000 7f7312ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.035+0000 7f7312ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.035+0000 7f7312ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 10 monclient(hunting): handle_auth_done global_id 4198 payload 824 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 1 -- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c0af7f0 msgr2=0x7f731c147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c0af7f0 0x7f731c147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 1 -- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f731c06bb50 msgr2=0x7f731c146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f731c06bb50 0x7f731c146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 10 monclient: _finish_hunting 0 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 1 monclient: found mon.noname-b 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:43.042 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:32:43.043 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.036+0000 7f731bfff640 1 -- 172.21.15.116:0/1015545613 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7314009a70 con 0x7f731c0b0960 2024-01-23T07:32:43.043 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.039+0000 7f731bfff640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c0b0960 0x7f731c1d77b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f731400efc0 tx=0x7f7314009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:43.043 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.039+0000 7f7318ff9640 10 client.?.objecter ms_handle_connect 0x7f731c0b0960 2024-01-23T07:32:43.043 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.039+0000 7f7318ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:43.045 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 1 -- 172.21.15.116:0/1015545613 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314009d70 con 0x7f731c0b0960 2024-01-23T07:32:43.045 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:43.045 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:32:43.045 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: dump: 2024-01-23T07:32:43.045 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:43.045 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: _finish_auth 0 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: _check_auth_tickets 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 1 -- 172.21.15.116:0/1015545613 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400f040 con 0x7f731c0b0960 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 5 monclient: authenticate success, global_id 4198 2024-01-23T07:32:43.046 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 10 monclient: _renew_subs 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730c009400 con 0x7f731c0b0960 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 1 -- 172.21.15.116:0/1015545613 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314003990 con 0x7f731c0b0960 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7318ff9640 10 monclient: dump: 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:43.047 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f731a7fc640 4 set_mon_vals no callback set 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 10 client.4198.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 10 monclient: _renew_subs 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c147ca0 con 0x7f731c0b0960 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.044+0000 7f7321f05640 1 librados: init done 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.045+0000 7f7321f05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.045+0000 7f7321f05640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.045+0000 7f7321f05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:43.048 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.045+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c1d74d0 con 0x7f731c0b0960 2024-01-23T07:32:43.064 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.064+0000 7f7318ff9640 1 -- 172.21.15.116:0/1015545613 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7f7314014480 con 0x7f731c0b0960 2024-01-23T07:32:43.064 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.064+0000 7f7318ff9640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72fc06c850 0x7f72fc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:43.065 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.064+0000 7f731b7fe640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72fc06c850 0x7f72fc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:43.065 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.064+0000 7f731b7fe640 10 monclient: get_auth_request con 0x7f72fc06c850 auth_method 0 2024-01-23T07:32:43.065 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.065+0000 7f7318ff9640 10 client.4198.objecter ms_handle_connect 0x7f72fc06c850 2024-01-23T07:32:43.065 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.065+0000 7f731b7fe640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72fc06c850 0x7f72fc06ed10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f730c036000 tx=0x7f730c03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:43.072 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:09.548 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.074 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:09.547 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.108 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:09.584 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.229 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.701 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.239 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:09.702 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.259 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:09.727 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.278 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:09.753 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.303+0000 7f7318ff9640 1 -- 172.21.15.116:0/1015545613 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f73140592f0 con 0x7f731c0b0960 2024-01-23T07:32:43.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.303+0000 7f7318ff9640 10 client.4198.objecter ms_dispatch 0x7f731c000b90 osd_map(10..10 src has 1..10) v4 2024-01-23T07:32:43.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.303+0000 7f7318ff9640 3 client.4198.objecter handle_osd_map got epochs [10,10] > 0 2024-01-23T07:32:43.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.303+0000 7f7318ff9640 3 client.4198.objecter handle_osd_map decoding full epoch 10 2024-01-23T07:32:43.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.303+0000 7f7318ff9640 20 client.4198.objecter dump_active .. 0 homeless 2024-01-23T07:32:43.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.306+0000 7f7318ff9640 1 -- 172.21.15.116:0/1015545613 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f7314055630 con 0x7f731c0b0960 2024-01-23T07:32:43.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.306+0000 7f7318ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:43.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.306+0000 7f7318ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:43.327 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:09.785 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.345 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:09.817 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.371 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:09.847 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.428 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:09.903 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.482 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.482+0000 7f7321f05640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:43.482 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.482+0000 7f7321f05640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:43.483 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.482+0000 7f7321f05640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:32:43.483 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.482+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f731c1d74d0 con 0x7f731c0b0960 2024-01-23T07:32:43.494 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:09.967 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.497 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.497+0000 7f7318ff9640 1 -- 172.21.15.116:0/1015545613 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f731c1d74d0 con 0x7f731c0b0960 2024-01-23T07:32:43.498 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.497+0000 7f7318ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:43.498 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.497+0000 7f7318ff9640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:43.498 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:32:43.498 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:32:33.359618+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:32:43.500 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 10 librados: watch_flush enter 2024-01-23T07:32:43.500 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 10 librados: watch_flush exit 2024-01-23T07:32:43.500 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 20 client.4198.objecter shutdown clearing up homeless session... 2024-01-23T07:32:43.500 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 10 client.4198.objecter successfully canceled tick 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72fc06c850 msgr2=0x7f72fc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72fc06c850 0x7f72fc06ed10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f730c036000 tx=0x7f730c03c040 comp rx=0 tx=0).stop 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 10 monclient: shutdown 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c0b0960 msgr2=0x7f731c1d77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c0b0960 0x7f731c1d77b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f731400efc0 tx=0x7f7314009f90 comp rx=0 tx=0).stop 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 shutdown_connections 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72fc06c850 0x7f72fc06ed10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f731c0b0960 0x7f731c1d77b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f731c0af7f0 0x7f731c147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 --2- 172.21.15.116:0/1015545613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f731c06bb50 0x7f731c146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 >> 172.21.15.116:0/1015545613 conn(0x7f731c066eb0 msgr2=0x7f731c0ae3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 shutdown_connections 2024-01-23T07:32:43.501 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.499+0000 7f7321f05640 1 -- 172.21.15.116:0/1015545613 wait complete. 2024-01-23T07:32:43.502 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:43.500+0000 7f7321f05640 1 librados: shutdown 2024-01-23T07:32:43.509 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-23T07:32:43.523 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:09.991 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.532 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:09.995 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.555 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:10.030 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.611 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:10.083 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.619 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:10.077 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.659 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:10.135 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.692 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:10.168 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.759 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:10.231 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.793 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:10.260 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.827 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:10.290 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.829 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:10.304 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.875 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:10.348 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.906 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:10.364 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.946 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:10.422 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:43.963 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:10.439 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.023 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:10.495 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.067 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:10.535 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.097 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:10.572 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.121 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:10.584 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.145 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:10.617 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.193 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:10.651 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.231 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:10.706 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.234 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:10.710 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.288 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:10.760 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.332 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:10.800 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.365 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:10.839 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.409 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:10.872 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.410 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:10.881 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.481 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:10.939 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.504 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:10.980 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.521 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:10.997 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.597 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:11.065 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.629 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:11.104 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.701 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:11.164 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.755 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:11.227 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.771 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:11.229 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.778 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:11.254 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.809 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:11.281 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.879 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:11.351 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.933 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:11.406 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:44.989 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:11.452 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.042 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:11.518 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.043 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:11.519 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.066 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:11.524 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.087 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:11.554 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.096 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:11.571 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.131 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:11.608 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.149 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:11.624 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.166 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:11.633 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.572 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:12.035 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.581 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:12.056 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.627 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:12.090 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.649 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:12.107 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.653 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:12.129 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:45.714 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:12.173 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:50.304 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:16.776 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:50.317 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:32:50.331 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:16.803 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:50.429 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.428+0000 7f75270b1640 10 monclient: get_monmap_and_config 2024-01-23T07:32:50.429 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.428+0000 7f75270b1640 10 monclient: build_initial_monmap 2024-01-23T07:32:50.429 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.428+0000 7f75270b1640 10 monclient: monmap: 2024-01-23T07:32:50.429 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:50.429 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:50.429 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:32:50.429965+0000 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:32:50.429965+0000 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:50.430 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.429+0000 7f75270b1640 1 Processor -- start 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.429+0000 7f75270b1640 1 -- start start 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.429+0000 7f75270b1640 10 monclient: init 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f752006c3a0 addr v1:172.21.15.116:6789/0 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f752013fa80 0x7f7520142090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:50.433 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient(hunting): picked mon.noname-c con 0x7f752013fa80 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f75200a9e50 0x7f75201425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient(hunting): picked mon.noname-a con 0x7f75200a9e50 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75200aaef0 con 0x7f752006c3a0 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752006c780 con 0x7f75200a9e50 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75200ab1d0 con 0x7f752013fa80 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.430+0000 7f75270b1640 10 monclient(hunting): authenticate will time out at 2377.789184s 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.431+0000 7f752564e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f75200a9e50 0x7f75201425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.431+0000 7f752564e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f75200a9e50 0x7f75201425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57614/0 (socket says 172.21.15.116:57614) 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.431+0000 7f752564e640 1 -- 172.21.15.116:0/617480563 learned_addr learned my addr 172.21.15.116:0/617480563 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.431+0000 7f752564e640 10 monclient(hunting): get_auth_request con 0x7f75200a9e50 auth_method 0 2024-01-23T07:32:50.434 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.431+0000 7f752564e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:50.435 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.431+0000 7f752564e640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:50.435 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.431+0000 7f752564e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:50.435 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.432+0000 7f752564e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:50.435 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.432+0000 7f752564e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:50.435 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.432+0000 7f752564e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:50.436 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 10 monclient(hunting): handle_auth_done global_id 4215 payload 274 2024-01-23T07:32:50.436 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 1 -- 172.21.15.116:0/617480563 >> v2:172.21.15.173:3300/0 conn(0x7f752013fa80 msgr2=0x7f7520142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:50.436 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 1 --2- 172.21.15.116:0/617480563 >> v2:172.21.15.173:3300/0 conn(0x7f752013fa80 0x7f7520142090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:50.436 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 1 -- 172.21.15.116:0/617480563 >> v1:172.21.15.116:6789/0 conn(0x7f752006c3a0 legacy=0x7f752013f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:50.436 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 10 monclient: _finish_hunting 0 2024-01-23T07:32:50.436 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 1 monclient: found mon.noname-a 2024-01-23T07:32:50.437 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:50.437 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:50.437 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.434+0000 7f752564e640 1 -- 172.21.15.116:0/617480563 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200b3d60 con 0x7f75200a9e50 2024-01-23T07:32:50.441 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.441+0000 7f752564e640 1 --2- 172.21.15.116:0/617480563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f75201425d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5604d9bdd8d489c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 1 -- 172.21.15.116:0/617480563 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751802c9f0 con 0x7f75200a9e50 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: dump: 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:50.449 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: _finish_auth 0 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 1 -- 172.21.15.116:0/617480563 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751802cb50 con 0x7f75200a9e50 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 1 -- 172.21.15.116:0/617480563 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75180343f0 con 0x7f75200a9e50 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f751f7fe640 10 monclient: dump: 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.450 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f75270b1640 5 monclient: authenticate success, global_id 4215 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f75270b1640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.446+0000 7f75270b1640 4 set_mon_vals no callback set 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 10 monclient: shutdown 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 -- 172.21.15.116:0/617480563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 msgr2=0x7f75201425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 --2- 172.21.15.116:0/617480563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f75201425d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7518009e50 tx=0x7f751802be50 comp rx=0 tx=0).stop 2024-01-23T07:32:50.451 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 -- 172.21.15.116:0/617480563 shutdown_connections 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 --2- 172.21.15.116:0/617480563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f75201425d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 --2- 172.21.15.116:0/617480563 >> v2:172.21.15.173:3300/0 conn(0x7f752013fa80 0x7f7520142090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 -- 172.21.15.116:0/617480563 >> 172.21.15.116:0/617480563 conn(0x7f75200b7c20 msgr2=0x7f75200b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 -- 172.21.15.116:0/617480563 shutdown_connections 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.447+0000 7f75270b1640 1 -- 172.21.15.116:0/617480563 wait complete. 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.449+0000 7f75270b1640 10 monclient: build_initial_monmap 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.449+0000 7f75270b1640 10 monclient: monmap: 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:50.452 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:50.453 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:50.453 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:50.453 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.449+0000 7f75270b1640 1 librados: starting msgr at 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.449+0000 7f75270b1640 1 librados: starting objecter 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.450+0000 7f75270b1640 1 Processor -- start 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.450+0000 7f75270b1640 1 -- start start 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.450+0000 7f75270b1640 1 librados: setting wanted keys 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.450+0000 7f75270b1640 1 librados: calling monclient init 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.450+0000 7f75270b1640 10 monclient: init 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.451+0000 7f75270b1640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.451+0000 7f75270b1640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:32:50.456 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.451+0000 7f75270b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f752006c3a0 0x7f752013b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.451+0000 7f75270b1640 10 monclient(hunting): picked mon.noname-b con 0x7f752006c3a0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.451+0000 7f75270b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f7520136ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 10 monclient(hunting): picked mon.noname-a con 0x7f75200a9e50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f752013fa80 0x7f7520137430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 10 monclient(hunting): picked mon.noname-c con 0x7f752013fa80 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752013a490 con 0x7f75200a9e50 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7520136ad0 con 0x7f752006c3a0 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752013a670 con 0x7f752013fa80 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f751ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f7520136ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:50.457 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.452+0000 7f75270b1640 10 monclient(hunting): authenticate will time out at 2377.811036s 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f7520136ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:57620/0 (socket says 172.21.15.116:57620) 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 1 -- 172.21.15.116:0/4245057423 learned_addr learned my addr 172.21.15.116:0/4245057423 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 10 monclient(hunting): get_auth_request con 0x7f75200a9e50 auth_method 0 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:50.458 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.453+0000 7f751ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.457+0000 7f751ffff640 10 monclient(hunting): handle_auth_done global_id 4218 payload 824 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.457+0000 7f751ffff640 1 -- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f752013fa80 msgr2=0x7f7520137430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.457+0000 7f751ffff640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f752013fa80 0x7f7520137430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.457+0000 7f751ffff640 1 -- 172.21.15.116:0/4245057423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f752006c3a0 msgr2=0x7f752013b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.457+0000 7f751ffff640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f752006c3a0 0x7f752013b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.458+0000 7f751ffff640 10 monclient: _finish_hunting 0 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.458+0000 7f751ffff640 1 monclient: found mon.noname-a 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.458+0000 7f751ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.458+0000 7f751ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:50.459 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.458+0000 7f751ffff640 1 -- 172.21.15.116:0/4245057423 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009b30 con 0x7f75200a9e50 2024-01-23T07:32:50.461 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.461+0000 7f751ffff640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f7520136ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f750c00b410 tx=0x7f750c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:50.461 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.461+0000 7f751d7fa640 10 client.?.objecter ms_handle_connect 0x7f75200a9e50 2024-01-23T07:32:50.462 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.461+0000 7f751d7fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:50.466 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 1 -- 172.21.15.116:0/4245057423 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011830 con 0x7f75200a9e50 2024-01-23T07:32:50.466 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: dump: 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: _finish_auth 0 2024-01-23T07:32:50.467 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: _check_auth_tickets 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 1 -- 172.21.15.116:0/4245057423 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c0119b0 con 0x7f75200a9e50 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f75270b1640 5 monclient: authenticate success, global_id 4218 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 1 -- 172.21.15.116:0/4245057423 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011d60 con 0x7f75200a9e50 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751d7fa640 10 monclient: dump: 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:50.468 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:50.469 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:50.469 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:50.469 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:50.469 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:50.469 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.466+0000 7f751effd640 4 set_mon_vals no callback set 2024-01-23T07:32:50.470 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 10 monclient: _renew_subs 2024-01-23T07:32:50.470 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:50.470 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752013a950 con 0x7f75200a9e50 2024-01-23T07:32:50.470 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 10 client.4218.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:50.470 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 10 monclient: _renew_subs 2024-01-23T07:32:50.470 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:50.470 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7520139ac0 con 0x7f75200a9e50 2024-01-23T07:32:50.471 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.467+0000 7f75270b1640 1 librados: init done 2024-01-23T07:32:50.471 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.468+0000 7f75270b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:50.471 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.468+0000 7f75270b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:50.471 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.468+0000 7f75270b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:50.471 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.468+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7520136830 con 0x7f75200a9e50 2024-01-23T07:32:50.606 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:17.082 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:50.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.842+0000 7f751d7fa640 1 -- 172.21.15.116:0/4245057423 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7f750c01a400 con 0x7f75200a9e50 2024-01-23T07:32:50.843 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.842+0000 7f751d7fa640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f750406c7d0 0x7f750406ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:50.843 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.843+0000 7f7524e4d640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f750406c7d0 0x7f750406ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:50.843 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.843+0000 7f7524e4d640 10 monclient: get_auth_request con 0x7f750406c7d0 auth_method 0 2024-01-23T07:32:50.843 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.843+0000 7f751d7fa640 10 client.4218.objecter ms_handle_connect 0x7f750406c7d0 2024-01-23T07:32:50.843 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.843+0000 7f7524e4d640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f750406c7d0 0x7f750406ec90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7514003cc0 tx=0x7f75140079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:50.863 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 1 -- 172.21.15.116:0/4245057423 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f750c00f2e0 con 0x7f75200a9e50 2024-01-23T07:32:50.863 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 10 client.4218.objecter ms_dispatch 0x7f7520000b90 osd_map(10..10 src has 1..10) v4 2024-01-23T07:32:50.863 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 3 client.4218.objecter handle_osd_map got epochs [10,10] > 0 2024-01-23T07:32:50.863 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 3 client.4218.objecter handle_osd_map decoding full epoch 10 2024-01-23T07:32:50.864 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 20 client.4218.objecter dump_active .. 0 homeless 2024-01-23T07:32:50.864 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 1 -- 172.21.15.116:0/4245057423 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f750c054990 con 0x7f75200a9e50 2024-01-23T07:32:50.864 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:50.864 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:50.863+0000 7f751d7fa640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:50.868 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:17.343 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:50.960 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:17.427 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:51.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.145+0000 7f75270b1640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:51.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.145+0000 7f75270b1640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:51.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.145+0000 7f75270b1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:51.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.146+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7520136830 con 0x7f75200a9e50 2024-01-23T07:32:51.192 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.192+0000 7f751d7fa640 1 -- 172.21.15.116:0/4245057423 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f7520136830 con 0x7f75200a9e50 2024-01-23T07:32:51.192 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.192+0000 7f751d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:51.192 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.192+0000 7f751d7fa640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:51.192 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:32:51.192 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:32:33.359618+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:32:51.195 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 10 librados: watch_flush enter 2024-01-23T07:32:51.195 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 10 librados: watch_flush exit 2024-01-23T07:32:51.195 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 20 client.4218.objecter shutdown clearing up homeless session... 2024-01-23T07:32:51.195 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 10 client.4218.objecter successfully canceled tick 2024-01-23T07:32:51.195 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f750406c7d0 msgr2=0x7f750406ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:51.195 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f750406c7d0 0x7f750406ec90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7514003cc0 tx=0x7f75140079b0 comp rx=0 tx=0).stop 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 10 monclient: shutdown 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 msgr2=0x7f7520136ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.194+0000 7f75270b1640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f7520136ef0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f750c00b410 tx=0x7f750c00b8d0 comp rx=0 tx=0).stop 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.195+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 shutdown_connections 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.195+0000 7f75270b1640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f750406c7d0 0x7f750406ec90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.195+0000 7f75270b1640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f752013fa80 0x7f7520137430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.195+0000 7f75270b1640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f75200a9e50 0x7f7520136ef0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:51.196 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.195+0000 7f75270b1640 1 --2- 172.21.15.116:0/4245057423 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f752006c3a0 0x7f752013b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:51.197 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.195+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 >> 172.21.15.116:0/4245057423 conn(0x7f75200b7c20 msgr2=0x7f75200b7210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:51.197 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.195+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 shutdown_connections 2024-01-23T07:32:51.197 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.196+0000 7f75270b1640 1 -- 172.21.15.116:0/4245057423 wait complete. 2024-01-23T07:32:51.197 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:51.196+0000 7f75270b1640 1 librados: shutdown 2024-01-23T07:32:51.210 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-23T07:32:51.298 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:17.761 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:51.452 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:17.911 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:51.511 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:17.986 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:55.575 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:22.047 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:55.579 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:22.051 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:55.835 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:22.307 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:55.839 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:22.311 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.158 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:22.634 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.162 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:22.639 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.372 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:22.846 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.377 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:22.852 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.536 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:23.004 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.542 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:23.010 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.867 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:23.329 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:56.870 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:23.333 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:57.211 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:23.669 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:57.214 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:23.690 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:57.215 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:23.674 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:57.218 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:23.694 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:32:58.016 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:32:58.123 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.123+0000 7f66a197c640 10 monclient: get_monmap_and_config 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.123+0000 7f66a197c640 10 monclient: build_initial_monmap 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.123+0000 7f66a197c640 10 monclient: monmap: 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:32:58.124351+0000 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:32:58.124351+0000 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:32:58.124 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:32:58.125 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:32:58.125 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:32:58.125 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:32:58.125 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:58.125 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.123+0000 7f66a197c640 1 Processor -- start 2024-01-23T07:32:58.125 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.123+0000 7f66a197c640 1 -- start start 2024-01-23T07:32:58.125 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.123+0000 7f66a197c640 10 monclient: init 2024-01-23T07:32:58.127 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:58.127 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2024-01-23T07:32:58.127 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f669c06c3a0 0x7f669c13f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient(hunting): picked mon.noname-c con 0x7f669c06c3a0 addr v2:172.21.15.173:3300/0 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f669c0a9e50 addr v1:172.21.15.173:6789/0 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f669c13f8b0 0x7f669c1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient(hunting): picked mon.noname-a con 0x7f669c13f8b0 addr v2:172.21.15.116:3300/0 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c0aaef0 con 0x7f669c0a9e50 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c13fd40 con 0x7f669c13f8b0 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c142ce0 con 0x7f669c06c3a0 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:58.128 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.124+0000 7f66a197c640 10 monclient(hunting): authenticate will time out at 2385.482790s 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669b7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f669c13f8b0 0x7f669c1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f669c06c3a0 0x7f669c13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669b7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f669c13f8b0 0x7f669c1427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:44384/0 (socket says 172.21.15.116:44384) 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669b7fe640 1 -- 172.21.15.116:0/3107619868 learned_addr learned my addr 172.21.15.116:0/3107619868 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669b7fe640 10 monclient(hunting): get_auth_request con 0x7f669c13f8b0 auth_method 0 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669affd640 10 monclient(hunting): get_auth_request con 0x7f669c06c3a0 auth_method 0 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669affd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.125+0000 7f669affd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:58.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.126+0000 7f669b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:58.130 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.126+0000 7f669b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:58.130 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.126+0000 7f669b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:58.130 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.126+0000 7f669affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:58.130 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.126+0000 7f669affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:58.130 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.126+0000 7f669affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 10 monclient(hunting): handle_auth_done global_id 4221 payload 274 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 1 -- 172.21.15.116:0/3107619868 >> v2:172.21.15.173:3300/0 conn(0x7f669c06c3a0 msgr2=0x7f669c13f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 1 --2- 172.21.15.116:0/3107619868 >> v2:172.21.15.173:3300/0 conn(0x7f669c06c3a0 0x7f669c13f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 1 -- 172.21.15.116:0/3107619868 >> v1:172.21.15.173:6789/0 conn(0x7f669c0a9e50 legacy=0x7f669c142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 1 monclient: found mon.noname-a 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.128+0000 7f669b7fe640 1 -- 172.21.15.116:0/3107619868 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c0ab1d0 con 0x7f669c13f8b0 2024-01-23T07:32:58.131 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.129+0000 7f669b7fe640 1 --2- 172.21.15.116:0/3107619868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c13f8b0 0x7f669c1427a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6694009e50 tx=0x7f669402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742f287437570e99 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:58.142 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 1 -- 172.21.15.116:0/3107619868 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669402ca80 con 0x7f669c13f8b0 2024-01-23T07:32:58.142 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: dump: 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: _finish_auth 0 2024-01-23T07:32:58.143 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 1 -- 172.21.15.116:0/3107619868 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669402cbe0 con 0x7f669c13f8b0 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f66a197c640 5 monclient: authenticate success, global_id 4221 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f66a197c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f66a197c640 10 monclient: get_monmap_and_config success 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f66a197c640 4 set_mon_vals no callback set 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 1 -- 172.21.15.116:0/3107619868 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940343f0 con 0x7f669c13f8b0 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.134+0000 7f6699ffb640 10 monclient: dump: 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:58.144 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 10 monclient: shutdown 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 -- 172.21.15.116:0/3107619868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c13f8b0 msgr2=0x7f669c1427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 --2- 172.21.15.116:0/3107619868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c13f8b0 0x7f669c1427a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6694009e50 tx=0x7f669402bee0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 -- 172.21.15.116:0/3107619868 shutdown_connections 2024-01-23T07:32:58.145 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 --2- 172.21.15.116:0/3107619868 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c13f8b0 0x7f669c1427a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 --2- 172.21.15.116:0/3107619868 >> v2:172.21.15.173:3300/0 conn(0x7f669c06c3a0 0x7f669c13f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 -- 172.21.15.116:0/3107619868 >> 172.21.15.116:0/3107619868 conn(0x7f669c0b7c20 msgr2=0x7f669c0b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 -- 172.21.15.116:0/3107619868 shutdown_connections 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.135+0000 7f66a197c640 1 -- 172.21.15.116:0/3107619868 wait complete. 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 10 monclient: build_initial_monmap 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 10 monclient: monmap: 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:32:58.146 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 1 librados: starting msgr at 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 1 librados: starting objecter 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 1 Processor -- start 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 1 -- start start 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 1 librados: setting wanted keys 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 1 librados: calling monclient init 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.136+0000 7f66a197c640 10 monclient: init 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient: _reopen_session rank -1 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f669c06c3a0 0x7f669c1371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:58.147 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): picked mon.noname-c con 0x7f669c06c3a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c0a9e50 0x7f669c131e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): picked mon.noname-a con 0x7f669c0a9e50 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c13f8b0 0x7f669c132370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): picked mon.noname-b con 0x7f669c13f8b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c13a210 con 0x7f669c0a9e50 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c1399a0 con 0x7f669c13f8b0 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c141cb0 con 0x7f669c06c3a0 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): _renew_subs 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.137+0000 7f66a197c640 10 monclient(hunting): authenticate will time out at 2385.495786s 2024-01-23T07:32:58.148 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669a7fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c0a9e50 0x7f669c131e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669affd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f669c06c3a0 0x7f669c1371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669b7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c13f8b0 0x7f669c132370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669a7fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c0a9e50 0x7f669c131e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:44400/0 (socket says 172.21.15.116:44400) 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669a7fc640 1 -- 172.21.15.116:0/2761120223 learned_addr learned my addr 172.21.15.116:0/2761120223 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669a7fc640 10 monclient(hunting): get_auth_request con 0x7f669c0a9e50 auth_method 0 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669a7fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669affd640 10 monclient(hunting): get_auth_request con 0x7f669c06c3a0 auth_method 0 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:58.149 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669affd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669affd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669b7fe640 10 monclient(hunting): get_auth_request con 0x7f669c13f8b0 auth_method 0 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.138+0000 7f669b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:32:58.150 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.139+0000 7f669b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 10 monclient(hunting): handle_auth_done global_id 4224 payload 824 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 1 -- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f669c06c3a0 msgr2=0x7f669c1371c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f669c06c3a0 0x7f669c1371c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 1 -- 172.21.15.116:0/2761120223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c13f8b0 msgr2=0x7f669c132370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c13f8b0 0x7f669c132370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 10 monclient: _finish_hunting 0 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 1 monclient: found mon.noname-a 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:32:58.151 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.142+0000 7f669a7fc640 1 -- 172.21.15.116:0/2761120223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009b30 con 0x7f669c0a9e50 2024-01-23T07:32:58.154 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.145+0000 7f669a7fc640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c0a9e50 0x7f669c131e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f669000c450 tx=0x7f669000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:58.154 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.145+0000 7f6683fff640 10 client.?.objecter ms_handle_connect 0x7f669c0a9e50 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.145+0000 7f6683fff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 1 -- 172.21.15.116:0/2761120223 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900052d0 con 0x7f669c0a9e50 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: dump: 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:58.155 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: _finish_auth 0 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: _check_auth_tickets 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 1 -- 172.21.15.116:0/2761120223 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690005430 con 0x7f669c0a9e50 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 5 monclient: authenticate success, global_id 4224 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:32:58.156 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 1 -- 172.21.15.116:0/2761120223 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690012870 con 0x7f669c0a9e50 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f6683fff640 10 monclient: dump: 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:32:58.157 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66997fa640 4 set_mon_vals no callback set 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 10 monclient: _renew_subs 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c141860 con 0x7f669c0a9e50 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 10 client.4224.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 10 monclient: _renew_subs 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c13b800 con 0x7f669c0a9e50 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.149+0000 7f66a197c640 1 librados: init done 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.151+0000 7f66a197c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.151+0000 7f66a197c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.151+0000 7f66a197c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:58.158 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.151+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c141ed0 con 0x7f669c0a9e50 2024-01-23T07:32:58.184 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.183+0000 7f6683fff640 1 -- 172.21.15.116:0/2761120223 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7f66900129d0 con 0x7f669c0a9e50 2024-01-23T07:32:58.184 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.184+0000 7f6683fff640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f668806c800 0x7f668806ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:32:58.184 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.184+0000 7f669affd640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f668806c800 0x7f668806ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:32:58.184 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.184+0000 7f669affd640 10 monclient: get_auth_request con 0x7f668806c800 auth_method 0 2024-01-23T07:32:58.185 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.184+0000 7f6683fff640 10 client.4224.objecter ms_handle_connect 0x7f668806c800 2024-01-23T07:32:58.185 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.184+0000 7f669affd640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f668806c800 0x7f668806ecc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f668c009b90 tx=0x7f668c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:32:58.191 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.190+0000 7f6683fff640 1 -- 172.21.15.116:0/2761120223 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f66900586f0 con 0x7f669c0a9e50 2024-01-23T07:32:58.191 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.190+0000 7f6683fff640 10 client.4224.objecter ms_dispatch 0x7f669c000b90 osd_map(10..10 src has 1..10) v4 2024-01-23T07:32:58.191 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.190+0000 7f6683fff640 3 client.4224.objecter handle_osd_map got epochs [10,10] > 0 2024-01-23T07:32:58.191 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.190+0000 7f6683fff640 3 client.4224.objecter handle_osd_map decoding full epoch 10 2024-01-23T07:32:58.191 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.190+0000 7f6683fff640 20 client.4224.objecter dump_active .. 0 homeless 2024-01-23T07:32:58.489 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.489+0000 7f6683fff640 1 -- 172.21.15.116:0/2761120223 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6690054a30 con 0x7f669c0a9e50 2024-01-23T07:32:58.489 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.489+0000 7f6683fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:32:58.489 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.489+0000 7f6683fff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:32:58.820 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.820+0000 7f66a197c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:58.821 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.820+0000 7f66a197c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:58.821 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.820+0000 7f66a197c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:32:58.821 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.820+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f669c139b60 con 0x7f669c0a9e50 2024-01-23T07:32:58.839 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.838+0000 7f6683fff640 1 -- 172.21.15.116:0/2761120223 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f6690058050 con 0x7f669c0a9e50 2024-01-23T07:32:58.839 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.838+0000 7f6683fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:32:58.839 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.838+0000 7f6683fff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:32:58.839 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:32:58.839 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:32:33.359618+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:32:58.840 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 10 librados: watch_flush enter 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 10 librados: watch_flush exit 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 20 client.4224.objecter shutdown clearing up homeless session... 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 10 client.4224.objecter successfully canceled tick 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f668806c800 msgr2=0x7f668806ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f668806c800 0x7f668806ecc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f668c009b90 tx=0x7f668c009190 comp rx=0 tx=0).stop 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 10 monclient: shutdown 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c0a9e50 msgr2=0x7f669c131e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:32:58.841 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c0a9e50 0x7f669c131e30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f669000c450 tx=0x7f669000c910 comp rx=0 tx=0).stop 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 shutdown_connections 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f668806c800 0x7f668806ecc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f669c13f8b0 0x7f669c132370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f669c0a9e50 0x7f669c131e30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 --2- 172.21.15.116:0/2761120223 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f669c06c3a0 0x7f669c1371c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 >> 172.21.15.116:0/2761120223 conn(0x7f669c0b7c20 msgr2=0x7f669c0b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 shutdown_connections 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.840+0000 7f66a197c640 1 -- 172.21.15.116:0/2761120223 wait complete. 2024-01-23T07:32:58.842 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:32:58.841+0000 7f66a197c640 1 librados: shutdown 2024-01-23T07:32:58.851 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-23T07:32:59.588 INFO:tasks.ceph.osd.5.smithi173.stderr:==00:00:00:26.061 34842== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:00.065 INFO:tasks.ceph.osd.6.smithi173.stderr:==00:00:00:26.537 34841== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:00.641 INFO:tasks.ceph.osd.4.smithi173.stderr:==00:00:00:27.117 34840== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:00.690 INFO:tasks.ceph.osd.7.smithi173.stderr:==00:00:00:27.157 34843== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:00.895 INFO:tasks.ceph.osd.0.smithi116.stderr:==00:00:00:27.370 34864== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:01.456 INFO:tasks.ceph.osd.1.smithi116.stderr:==00:00:00:27.918 34866== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:01.547 INFO:tasks.ceph.osd.3.smithi116.stderr:==00:00:00:28.005 34867== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:01.690 INFO:tasks.ceph.osd.2.smithi116.stderr:==00:00:00:28.165 34865== Warning: unimplemented fcntl command: 1038 2024-01-23T07:33:05.658 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:33:05.776 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.776+0000 7fe7b8b89640 10 monclient: get_monmap_and_config 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.776+0000 7fe7b8b89640 10 monclient: build_initial_monmap 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.776+0000 7fe7b8b89640 10 monclient: monmap: 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:33:05.777478+0000 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:33:05.777478+0000 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:05.777 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:05.778 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:05.778 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.776+0000 7fe7b8b89640 1 Processor -- start 2024-01-23T07:33:05.778 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.776+0000 7fe7b8b89640 1 -- start start 2024-01-23T07:33:05.778 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.776+0000 7fe7b8b89640 10 monclient: init 2024-01-23T07:33:05.779 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:05.779 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient: _add_conns ranks=[4,1,2,0,3] 2024-01-23T07:33:05.779 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe7b406c3a0 0x7fe7b413f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:05.779 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient(hunting): picked mon.noname-c con 0x7fe7b406c3a0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:05.779 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fe7b40a9e50 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b413f8b0 0x7fe7b41427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient(hunting): picked mon.noname-b con 0x7fe7b413f8b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40aaef0 con 0x7fe7b40a9e50 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b4142ce0 con 0x7fe7b406c3a0 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b406c780 con 0x7fe7b413f8b0 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.777+0000 7fe7b8b89640 10 monclient(hunting): authenticate will time out at 2393.136010s 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b2d9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b413f8b0 0x7fe7b41427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b259c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fe7b406c3a0 0x7fe7b413f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b2d9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b413f8b0 0x7fe7b41427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:49016/0 (socket says 172.21.15.116:49016) 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b2d9d640 1 -- 172.21.15.116:0/609239385 learned_addr learned my addr 172.21.15.116:0/609239385 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:05.780 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b2d9d640 10 monclient(hunting): get_auth_request con 0x7fe7b413f8b0 auth_method 0 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b2d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.778+0000 7fe7b2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.779+0000 7fe7b259c640 10 monclient(hunting): get_auth_request con 0x7fe7b406c3a0 auth_method 0 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.779+0000 7fe7b259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.779+0000 7fe7b259c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.779+0000 7fe7b259c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.779+0000 7fe7b2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.779+0000 7fe7b2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:05.781 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.779+0000 7fe7b2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:05.782 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.780+0000 7fe7b259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:05.782 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.780+0000 7fe7b259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:05.782 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.780+0000 7fe7b259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:05.782 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.780+0000 7fe7b2d9d640 10 monclient(hunting): handle_auth_done global_id 14174 payload 274 2024-01-23T07:33:05.782 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 1 -- 172.21.15.116:0/609239385 >> v2:172.21.15.173:3300/0 conn(0x7fe7b406c3a0 msgr2=0x7fe7b413f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:05.782 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 1 --2- 172.21.15.116:0/609239385 >> v2:172.21.15.173:3300/0 conn(0x7fe7b406c3a0 0x7fe7b413f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:05.783 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 1 -- 172.21.15.116:0/609239385 >> v1:172.21.15.173:6789/0 conn(0x7fe7b40a9e50 legacy=0x7fe7b4142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:05.783 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 10 monclient: _finish_hunting 0 2024-01-23T07:33:05.783 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 1 monclient: found mon.noname-b 2024-01-23T07:33:05.783 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:05.783 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:05.783 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.781+0000 7fe7b2d9d640 1 -- 172.21.15.116:0/609239385 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40ab1d0 con 0x7fe7b413f8b0 2024-01-23T07:33:05.783 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.783+0000 7fe7b2d9d640 1 --2- 172.21.15.116:0/609239385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b413f8b0 0x7fe7b41427a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009e50 tx=0x7fe7ac02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b52ef1856530443 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:05.786 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b159a640 1 -- 172.21.15.116:0/609239385 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac02c9e0 con 0x7fe7b413f8b0 2024-01-23T07:33:05.786 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:05.786 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b159a640 10 monclient: dump: 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:05.787 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:05.788 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b159a640 10 monclient: _finish_auth 0 2024-01-23T07:33:05.788 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b159a640 10 monclient: _check_auth_tickets 2024-01-23T07:33:05.788 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:05.788 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b8b89640 5 monclient: authenticate success, global_id 14174 2024-01-23T07:33:05.788 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.786+0000 7fe7b8b89640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b159a640 1 -- 172.21.15.116:0/609239385 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac02cb40 con 0x7fe7b413f8b0 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b159a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b159a640 1 -- 172.21.15.116:0/609239385 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0343f0 con 0x7fe7b413f8b0 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b159a640 10 monclient: dump: 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.790 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b8b89640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.788+0000 7fe7b8b89640 4 set_mon_vals no callback set 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 10 monclient: shutdown 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 -- 172.21.15.116:0/609239385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b413f8b0 msgr2=0x7fe7b41427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/609239385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b413f8b0 0x7fe7b41427a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009e50 tx=0x7fe7ac02be40 comp rx=0 tx=0).stop 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 -- 172.21.15.116:0/609239385 shutdown_connections 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/609239385 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b413f8b0 0x7fe7b41427a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:05.791 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/609239385 >> v2:172.21.15.173:3300/0 conn(0x7fe7b406c3a0 0x7fe7b413f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:05.792 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 -- 172.21.15.116:0/609239385 >> 172.21.15.116:0/609239385 conn(0x7fe7b40b7c20 msgr2=0x7fe7b40b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:05.792 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 -- 172.21.15.116:0/609239385 shutdown_connections 2024-01-23T07:33:05.792 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.789+0000 7fe7b8b89640 1 -- 172.21.15.116:0/609239385 wait complete. 2024-01-23T07:33:05.795 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.790+0000 7fe7b8b89640 10 monclient: build_initial_monmap 2024-01-23T07:33:05.795 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.790+0000 7fe7b8b89640 10 monclient: monmap: 2024-01-23T07:33:05.795 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:05.795 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.791+0000 7fe7b8b89640 1 librados: starting msgr at 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.791+0000 7fe7b8b89640 1 librados: starting objecter 2024-01-23T07:33:05.796 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.791+0000 7fe7b8b89640 1 Processor -- start 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.791+0000 7fe7b8b89640 1 -- start start 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.791+0000 7fe7b8b89640 1 librados: setting wanted keys 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.791+0000 7fe7b8b89640 1 librados: calling monclient init 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.791+0000 7fe7b8b89640 10 monclient: init 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b406c3a0 0x7fe7b413a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): picked mon.noname-c con 0x7fe7b406c3a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7b40a9e50 0x7fe7b41392f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): picked mon.noname-b con 0x7fe7b40a9e50 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:05.797 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b413f8b0 0x7fe7b4139830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): picked mon.noname-a con 0x7fe7b413f8b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b413afb0 con 0x7fe7b413f8b0 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40ac770 con 0x7fe7b40a9e50 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40aca50 con 0x7fe7b406c3a0 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b8b89640 10 monclient(hunting): authenticate will time out at 2393.150484s 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.792+0000 7fe7b259c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b406c3a0 0x7fe7b413a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b2d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b413f8b0 0x7fe7b4139830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:05.798 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b1d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7b40a9e50 0x7fe7b41392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b406c3a0 0x7fe7b413a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:49022/0 (socket says 172.21.15.116:49022) 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 1 -- 172.21.15.116:0/1138194104 learned_addr learned my addr 172.21.15.116:0/1138194104 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 10 monclient(hunting): get_auth_request con 0x7fe7b406c3a0 auth_method 0 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b2d9d640 10 monclient(hunting): get_auth_request con 0x7fe7b413f8b0 auth_method 0 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b2d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b2d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b2d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b1d9b640 10 monclient(hunting): get_auth_request con 0x7fe7b40a9e50 auth_method 0 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b1d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b1d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:05.799 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.793+0000 7fe7b259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.794+0000 7fe7b1d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.794+0000 7fe7b1d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.794+0000 7fe7b1d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.794+0000 7fe7b2d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.794+0000 7fe7b2d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:05.800 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.794+0000 7fe7b2d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:05.802 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 10 monclient(hunting): handle_auth_done global_id 4213 payload 824 2024-01-23T07:33:05.802 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 1 -- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b406c3a0 msgr2=0x7fe7b413a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:05.802 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b406c3a0 0x7fe7b413a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:05.802 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 1 -- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b413f8b0 msgr2=0x7fe7b4139830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:05.802 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b413f8b0 0x7fe7b4139830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:05.802 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:05.802 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 1 monclient: found mon.noname-b 2024-01-23T07:33:05.803 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:05.803 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:05.803 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.796+0000 7fe7b1d9b640 1 -- 172.21.15.116:0/1138194104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009b30 con 0x7fe7b40a9e50 2024-01-23T07:33:05.803 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.799+0000 7fe7b1d9b640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7b40a9e50 0x7fe7b41392f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c410 tx=0x7fe7a800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:05.803 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.799+0000 7fe7a2ffd640 10 client.?.objecter ms_handle_connect 0x7fe7b40a9e50 2024-01-23T07:33:05.803 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.799+0000 7fe7a2ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:05.808 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 1 -- 172.21.15.116:0/1138194104 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8005230 con 0x7fe7b40a9e50 2024-01-23T07:33:05.808 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:05.808 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:05.808 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: dump: 2024-01-23T07:33:05.808 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:05.808 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:05.809 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 1 -- 172.21.15.116:0/1138194104 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8005390 con 0x7fe7b40a9e50 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 1 -- 172.21.15.116:0/1138194104 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8004820 con 0x7fe7b40a9e50 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:05.810 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7a2ffd640 10 monclient: dump: 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:05.811 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.803+0000 7fe7b0d99640 4 set_mon_vals no callback set 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 5 monclient: authenticate success, global_id 4213 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 10 monclient: _renew_subs 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:05.812 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b40b6430 con 0x7fe7b40a9e50 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 10 client.4213.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 10 monclient: _renew_subs 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40ab8b0 con 0x7fe7b40a9e50 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.804+0000 7fe7b8b89640 1 librados: init done 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.805+0000 7fe7b8b89640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.805+0000 7fe7b8b89640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.805+0000 7fe7b8b89640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:05.813 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:05.805+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b4075e50 con 0x7fe7b40a9e50 2024-01-23T07:33:06.208 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.207+0000 7fe7a2ffd640 1 -- 172.21.15.116:0/1138194104 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7fe7a8004980 con 0x7fe7b40a9e50 2024-01-23T07:33:06.208 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.208+0000 7fe7a2ffd640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fe79406c7d0 0x7fe79406ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:06.209 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.208+0000 7fe7b259c640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fe79406c7d0 0x7fe79406ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:06.209 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.208+0000 7fe7b259c640 10 monclient: get_auth_request con 0x7fe79406c7d0 auth_method 0 2024-01-23T07:33:06.209 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.209+0000 7fe7b259c640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fe79406c7d0 0x7fe79406ec90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009c00 tx=0x7fe7a4009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:06.209 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.209+0000 7fe7a2ffd640 10 client.4213.objecter ms_handle_connect 0x7fe79406c7d0 2024-01-23T07:33:06.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.224+0000 7fe7a2ffd640 1 -- 172.21.15.116:0/1138194104 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe7a8057790 con 0x7fe7b40a9e50 2024-01-23T07:33:06.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.224+0000 7fe7a2ffd640 10 client.4213.objecter ms_dispatch 0x7fe7b4000b90 osd_map(10..10 src has 1..10) v4 2024-01-23T07:33:06.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.224+0000 7fe7a2ffd640 3 client.4213.objecter handle_osd_map got epochs [10,10] > 0 2024-01-23T07:33:06.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.224+0000 7fe7a2ffd640 3 client.4213.objecter handle_osd_map decoding full epoch 10 2024-01-23T07:33:06.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.224+0000 7fe7a2ffd640 20 client.4213.objecter dump_active .. 0 homeless 2024-01-23T07:33:06.225 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.225+0000 7fe7a2ffd640 1 -- 172.21.15.116:0/1138194104 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fe7a8053ad0 con 0x7fe7b40a9e50 2024-01-23T07:33:06.225 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.225+0000 7fe7a2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:06.225 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.225+0000 7fe7a2ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:06.598 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.597+0000 7fe7b8b89640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:06.598 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.597+0000 7fe7b8b89640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:06.598 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.597+0000 7fe7b8b89640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:06.598 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.597+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7b40b8420 con 0x7fe7b40a9e50 2024-01-23T07:33:06.616 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.615+0000 7fe7a2ffd640 1 -- 172.21.15.116:0/1138194104 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fe7a8017070 con 0x7fe7b40a9e50 2024-01-23T07:33:06.616 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.615+0000 7fe7a2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:06.616 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.615+0000 7fe7a2ffd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:06.616 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:33:06.616 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":10,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:32:33.359618+0000","last_up_change":"0.000000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:33:06.620 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 10 librados: watch_flush enter 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 10 librados: watch_flush exit 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 20 client.4213.objecter shutdown clearing up homeless session... 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 10 client.4213.objecter successfully canceled tick 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fe79406c7d0 msgr2=0x7fe79406ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fe79406c7d0 0x7fe79406ec90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009c00 tx=0x7fe7a4009190 comp rx=0 tx=0).stop 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 10 monclient: shutdown 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7b40a9e50 msgr2=0x7fe7b41392f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7b40a9e50 0x7fe7b41392f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c410 tx=0x7fe7a800c8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 shutdown_connections 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fe79406c7d0 0x7fe79406ec90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7b413f8b0 0x7fe7b4139830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:06.621 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7b40a9e50 0x7fe7b41392f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:06.622 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 --2- 172.21.15.116:0/1138194104 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fe7b406c3a0 0x7fe7b413a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:06.622 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 >> 172.21.15.116:0/1138194104 conn(0x7fe7b40b7c20 msgr2=0x7fe7b413f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:06.622 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 shutdown_connections 2024-01-23T07:33:06.622 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 -- 172.21.15.116:0/1138194104 wait complete. 2024-01-23T07:33:06.622 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:06.620+0000 7fe7b8b89640 1 librados: shutdown 2024-01-23T07:33:06.634 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-23T07:33:08.128 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:33:08.125+0000 5dc2480 -1 osd.5 0 log_to_monitors true 2024-01-23T07:33:08.356 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:33:08.353+0000 5dc2480 -1 osd.6 0 log_to_monitors true 2024-01-23T07:33:09.032 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:09.025+0000 5dc2480 -1 osd.4 0 log_to_monitors true 2024-01-23T07:33:09.176 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T07:33:09.173+0000 5dc2480 -1 osd.7 0 log_to_monitors true 2024-01-23T07:33:09.725 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:33:09.722+0000 5dc2480 -1 osd.0 0 log_to_monitors true 2024-01-23T07:33:10.130 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:10.121+0000 5dc2480 -1 osd.1 0 log_to_monitors true 2024-01-23T07:33:10.209 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:33:10.205+0000 5dc2480 -1 osd.2 0 log_to_monitors true 2024-01-23T07:33:10.292 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:10.289+0000 5dc2480 -1 osd.3 0 log_to_monitors true 2024-01-23T07:33:11.444 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:33:11.435+0000 ae7c640 -1 osd.5 0 waiting for initial osdmap 2024-01-23T07:33:11.491 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:33:11.483+0000 c692640 -1 osd.6 0 waiting for initial osdmap 2024-01-23T07:33:11.826 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:33:11.807+0000 10451640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:11.878 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:33:11.864+0000 10451640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:12.442 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:33:12.438+0000 ae7c640 -1 osd.0 0 waiting for initial osdmap 2024-01-23T07:33:12.522 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T07:33:12.516+0000 c692640 -1 osd.7 0 waiting for initial osdmap 2024-01-23T07:33:12.862 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:33:12.849+0000 10451640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:12.966 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T07:33:12.953+0000 10451640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:13.442 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:33:13.572 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.571+0000 7f738136b640 10 monclient: get_monmap_and_config 2024-01-23T07:33:13.572 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.571+0000 7f738136b640 10 monclient: build_initial_monmap 2024-01-23T07:33:13.572 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.571+0000 7f738136b640 10 monclient: monmap: 2024-01-23T07:33:13.572 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:13.572 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:33:13.573133+0000 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:33:13.573133+0000 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:13.573 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:13.577 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.573+0000 7f738136b640 1 Processor -- start 2024-01-23T07:33:13.577 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.573+0000 7f738136b640 1 -- start start 2024-01-23T07:33:13.577 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.573+0000 7f738136b640 10 monclient: init 2024-01-23T07:33:13.577 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:13.577 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient: _add_conns ranks=[4,0,2,3,1] 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f737c06c3a0 0x7f737c13f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient(hunting): picked mon.noname-c con 0x7f737c06c3a0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f737c0a9e50 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c13f8b0 0x7f737c1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient(hunting): picked mon.noname-b con 0x7f737c13f8b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c0aaef0 con 0x7f737c0a9e50 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c142ce0 con 0x7f737c06c3a0 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c06c780 con 0x7f737c13f8b0 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f738136b640 10 monclient(hunting): authenticate will time out at 2400.932378s 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f737b7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c13f8b0 0x7f737c1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:13.578 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.574+0000 7f737affd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f737c06c3a0 0x7f737c13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c13f8b0 0x7f737c1427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:49072/0 (socket says 172.21.15.116:49072) 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 1 -- 172.21.15.116:0/2630690160 learned_addr learned my addr 172.21.15.116:0/2630690160 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 10 monclient(hunting): get_auth_request con 0x7f737c13f8b0 auth_method 0 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737affd640 10 monclient(hunting): get_auth_request con 0x7f737c06c3a0 auth_method 0 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737affd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737affd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:13.579 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.575+0000 7f737b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 10 monclient(hunting): handle_auth_done global_id 4237 payload 274 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 1 -- 172.21.15.116:0/2630690160 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c13f8b0 msgr2=0x7f737c1427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 1 --2- 172.21.15.116:0/2630690160 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c13f8b0 0x7f737c1427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 1 -- 172.21.15.116:0/2630690160 >> v1:172.21.15.116:6789/0 conn(0x7f737c0a9e50 legacy=0x7f737c142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 1 monclient: found mon.noname-c 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:13.580 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.577+0000 7f737affd640 1 -- 172.21.15.116:0/2630690160 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0ab1d0 con 0x7f737c06c3a0 2024-01-23T07:33:13.581 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.579+0000 7f737affd640 1 --2- 172.21.15.116:0/2630690160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c06c3a0 0x7f737c13f370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f736c0097d0 tx=0x7f736c02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae84f137f9e02264 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:13.584 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 1 -- 172.21.15.116:0/2630690160 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0316f0 con 0x7f737c06c3a0 2024-01-23T07:33:13.584 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:13.584 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:13.584 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: dump: 2024-01-23T07:33:13.584 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:13.584 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 1 -- 172.21.15.116:0/2630690160 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c031850 con 0x7f737c06c3a0 2024-01-23T07:33:13.585 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 1 -- 172.21.15.116:0/2630690160 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c031be0 con 0x7f737c06c3a0 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f737a7fc640 10 monclient: dump: 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:13.586 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:13.587 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f738136b640 5 monclient: authenticate success, global_id 4237 2024-01-23T07:33:13.587 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f738136b640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:13.587 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.584+0000 7f738136b640 4 set_mon_vals no callback set 2024-01-23T07:33:13.592 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 10 monclient: shutdown 2024-01-23T07:33:13.592 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:13.592 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 -- 172.21.15.116:0/2630690160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c06c3a0 msgr2=0x7f737c13f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:13.592 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 --2- 172.21.15.116:0/2630690160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c06c3a0 0x7f737c13f370 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f736c0097d0 tx=0x7f736c02b790 comp rx=0 tx=0).stop 2024-01-23T07:33:13.592 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 -- 172.21.15.116:0/2630690160 shutdown_connections 2024-01-23T07:33:13.592 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 --2- 172.21.15.116:0/2630690160 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c13f8b0 0x7f737c1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 --2- 172.21.15.116:0/2630690160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c06c3a0 0x7f737c13f370 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 -- 172.21.15.116:0/2630690160 >> 172.21.15.116:0/2630690160 conn(0x7f737c0b7c20 msgr2=0x7f737c0b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 -- 172.21.15.116:0/2630690160 shutdown_connections 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 1 -- 172.21.15.116:0/2630690160 wait complete. 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 10 monclient: build_initial_monmap 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.585+0000 7f738136b640 10 monclient: monmap: 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:13.593 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 librados: starting msgr at 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 librados: starting objecter 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 Processor -- start 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 -- start start 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 librados: setting wanted keys 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 librados: calling monclient init 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient: init 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c06c3a0 0x7f737c13b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:13.594 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): picked mon.noname-c con 0x7f737c06c3a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c0a9e50 0x7f737c0ac300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): picked mon.noname-b con 0x7f737c0a9e50 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f737c13f8b0 0x7f737c0ac840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): picked mon.noname-a con 0x7f737c13f8b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c1339b0 con 0x7f737c13f8b0 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0ab920 con 0x7f737c0a9e50 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0abc00 con 0x7f737c06c3a0 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.586+0000 7f738136b640 10 monclient(hunting): authenticate will time out at 2400.945113s 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f737affd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c06c3a0 0x7f737c13b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:13.595 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f7373fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c0a9e50 0x7f737c0ac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f737affd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c06c3a0 0x7f737c13b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:49084/0 (socket says 172.21.15.116:49084) 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f737affd640 1 -- 172.21.15.116:0/1353870273 learned_addr learned my addr 172.21.15.116:0/1353870273 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f737affd640 10 monclient(hunting): get_auth_request con 0x7f737c06c3a0 auth_method 0 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f737affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f737affd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f737affd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f7373fff640 10 monclient(hunting): get_auth_request con 0x7f737c0a9e50 auth_method 0 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f7373fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f7373fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.587+0000 7f7373fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.588+0000 7f737affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.588+0000 7f737affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:13.596 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.588+0000 7f737affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.588+0000 7f7373fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.588+0000 7f7373fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.588+0000 7f7373fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 10 monclient(hunting): handle_auth_done global_id 14204 payload 824 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 1 -- 172.21.15.116:0/1353870273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c0a9e50 msgr2=0x7f737c0ac300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c0a9e50 0x7f737c0ac300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 1 -- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f737c13f8b0 msgr2=0x7f737c0ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f737c13f8b0 0x7f737c0ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 1 monclient: found mon.noname-c 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:13.597 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.591+0000 7f737affd640 1 -- 172.21.15.116:0/1353870273 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c009400 con 0x7f737c06c3a0 2024-01-23T07:33:13.600 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.593+0000 7f737affd640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c06c3a0 0x7f737c13b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f736c0098f0 tx=0x7f736c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.593+0000 7f73737fe640 10 client.?.objecter ms_handle_connect 0x7f737c06c3a0 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.593+0000 7f73737fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.596+0000 7f73737fe640 1 -- 172.21.15.116:0/1353870273 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c034680 con 0x7f737c06c3a0 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.596+0000 7f73737fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: dump: 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:13.601 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 1 -- 172.21.15.116:0/1353870273 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c034820 con 0x7f737c06c3a0 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f7379ffb640 4 set_mon_vals no callback set 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 1 -- 172.21.15.116:0/1353870273 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c034bd0 con 0x7f737c06c3a0 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f73737fe640 10 monclient: dump: 2024-01-23T07:33:13.602 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 5 monclient: authenticate success, global_id 14204 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 10 monclient: _renew_subs 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c135280 con 0x7f737c06c3a0 2024-01-23T07:33:13.603 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 10 client.14204.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 10 monclient: _renew_subs 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c13c7b0 con 0x7f737c06c3a0 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.597+0000 7f738136b640 1 librados: init done 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.598+0000 7f738136b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.598+0000 7f738136b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.598+0000 7f738136b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:13.604 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.598+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c075e50 con 0x7f737c06c3a0 2024-01-23T07:33:13.868 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.868+0000 7f73737fe640 1 -- 172.21.15.116:0/1353870273 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 4) v1 ==== 89150+0+0 (secure 0 0 0) 0x7f736c03b040 con 0x7f737c06c3a0 2024-01-23T07:33:13.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.868+0000 7f73737fe640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f735c06c7d0 0x7f735c06ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:13.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.868+0000 7f7373fff640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f735c06c7d0 0x7f735c06ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:13.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.868+0000 7f7373fff640 10 monclient: get_auth_request con 0x7f735c06c7d0 auth_method 0 2024-01-23T07:33:13.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.869+0000 7f7373fff640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f735c06c7d0 0x7f735c06ec90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f737c1393b0 tx=0x7f7364009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:13.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.869+0000 7f73737fe640 10 client.14204.objecter ms_handle_connect 0x7f735c06c7d0 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 1 -- 172.21.15.116:0/1353870273 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3446+0+0 (secure 0 0 0) 0x7f736c079fa0 con 0x7f737c06c3a0 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 10 client.14204.objecter ms_dispatch 0x7f737c000b90 osd_map(14..14 src has 1..14) v4 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 3 client.14204.objecter handle_osd_map got epochs [14,14] > 0 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 3 client.14204.objecter handle_osd_map decoding full epoch 14 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 20 client.14204.objecter dump_active .. 0 homeless 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 1 -- 172.21.15.116:0/1353870273 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f736c0762e0 con 0x7f737c06c3a0 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:13.894 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:13.893+0000 7f73737fe640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:14.126 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.125+0000 7f738136b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:14.126 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.125+0000 7f738136b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:14.126 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.125+0000 7f738136b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:14.126 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.125+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f737c13d570 con 0x7f737c06c3a0 2024-01-23T07:33:14.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.302+0000 7f73737fe640 1 -- 172.21.15.116:0/1353870273 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10347 (secure 0 0 0) 0x7f736c079900 con 0x7f737c06c3a0 2024-01-23T07:33:14.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.303+0000 7f73737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:14.303 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.303+0000 7f73737fe640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:14.303 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:33:14.304 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":14,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:33:13.116593+0000","last_up_change":"2024-01-23T07:33:13.116593+0000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T07:33:12.781798+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6803","nonce":950064745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6805","nonce":950064745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6809","nonce":950064745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6807","nonce":950064745}]},"public_addr":"172.21.15.116:6803/950064745","cluster_addr":"172.21.15.116:6805/950064745","heartbeat_back_addr":"172.21.15.116:6809/950064745","heartbeat_front_addr":"172.21.15.116:6807/950064745","state":["exists","up"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6801","nonce":1137022367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6803","nonce":1137022367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6809","nonce":1137022367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6805","nonce":1137022367}]},"public_addr":"172.21.15.173:6801/1137022367","cluster_addr":"172.21.15.173:6803/1137022367","heartbeat_back_addr":"172.21.15.173:6809/1137022367","heartbeat_front_addr":"172.21.15.173:6805/1137022367","state":["exists","up"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6817","nonce":548415989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6819","nonce":548415989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6823","nonce":548415989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6821","nonce":548415989}]},"public_addr":"172.21.15.173:6817/548415989","cluster_addr":"172.21.15.173:6819/548415989","heartbeat_back_addr":"172.21.15.173:6823/548415989","heartbeat_front_addr":"172.21.15.173:6821/548415989","state":["exists","up"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.482296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:33:14.305 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.304+0000 7f738136b640 10 librados: watch_flush enter 2024-01-23T07:33:14.305 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.304+0000 7f738136b640 10 librados: watch_flush exit 2024-01-23T07:33:14.305 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.304+0000 7f738136b640 20 client.14204.objecter shutdown clearing up homeless session... 2024-01-23T07:33:14.305 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.304+0000 7f738136b640 10 client.14204.objecter successfully canceled tick 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.304+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f735c06c7d0 msgr2=0x7f735c06ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f735c06c7d0 0x7f735c06ec90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f737c1393b0 tx=0x7f7364009040 comp rx=0 tx=0).stop 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 10 monclient: shutdown 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c06c3a0 msgr2=0x7f737c13b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c06c3a0 0x7f737c13b9c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f736c0098f0 tx=0x7f736c0046c0 comp rx=0 tx=0).stop 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 shutdown_connections 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f735c06c7d0 0x7f735c06ec90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f737c13f8b0 0x7f737c0ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737c0a9e50 0x7f737c0ac300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 --2- 172.21.15.116:0/1353870273 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f737c06c3a0 0x7f737c13b9c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:14.306 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 >> 172.21.15.116:0/1353870273 conn(0x7f737c0b7c20 msgr2=0x7f737c13d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:14.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 shutdown_connections 2024-01-23T07:33:14.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 -- 172.21.15.116:0/1353870273 wait complete. 2024-01-23T07:33:14.307 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:14.305+0000 7f738136b640 1 librados: shutdown 2024-01-23T07:33:14.315 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-01-23T07:33:14.340 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:33:14.334+0000 c692640 -1 osd.2 0 waiting for initial osdmap 2024-01-23T07:33:14.831 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:33:14.818+0000 10451640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:19.574 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:19.173+0000 5dc2480 -1 bdev(0x166bb370 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-01-23T07:33:19.585 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:19.575+0000 5dc2480 -1 bdev(0x166bb370 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-01-23T07:33:19.836 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:19.585+0000 5dc2480 -1 bdev(0x166bb370 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-01-23T07:33:19.837 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:19.596+0000 5dc2480 -1 bdev(0x166bb370 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-01-23T07:33:19.880 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:19.671+0000 5dc2480 -1 bdev(0x166bb370 /var/lib/ceph/osd/ceph-4/block) aio_submit retries 1 2024-01-23T07:33:20.758 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:20.636+0000 5dc2480 -1 bdev(0x19104170 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-01-23T07:33:20.823 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:20.649+0000 5dc2480 -1 bdev(0x19104170 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-01-23T07:33:20.833 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:20.728+0000 5dc2480 -1 bdev(0x19104170 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-01-23T07:33:20.840 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:20.733+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-01-23T07:33:20.840 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:20.781+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-01-23T07:33:20.862 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:20.805+0000 5dc2480 -1 bdev(0x19104170 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-01-23T07:33:20.863 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:20.823+0000 5dc2480 -1 bdev(0x19104170 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-01-23T07:33:20.863 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:20.834+0000 5dc2480 -1 bdev(0x19104170 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-01-23T07:33:20.881 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:20.870+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-01-23T07:33:20.921 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:20.881+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-01-23T07:33:20.930 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:20.872+0000 5dc2480 -1 bdev(0x19104170 /var/lib/ceph/osd/ceph-1/block) aio_submit retries 1 2024-01-23T07:33:21.012 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:21.008+0000 c692640 -1 osd.4 0 waiting for initial osdmap 2024-01-23T07:33:21.015 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:20.921+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-01-23T07:33:21.047 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:21.016+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-01-23T07:33:21.101 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:21.047+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 1 2024-01-23T07:33:21.121 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.220+0000 7fd46b912640 10 monclient: get_monmap_and_config 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.220+0000 7fd46b912640 10 monclient: build_initial_monmap 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.220+0000 7fd46b912640 10 monclient: monmap: 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:33:21.221915+0000 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:33:21.221915+0000 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:21.221 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:21.222 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:21.222 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:21.222 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:21.223 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.221+0000 7fd46b912640 1 Processor -- start 2024-01-23T07:33:21.223 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.221+0000 7fd46b912640 1 -- start start 2024-01-23T07:33:21.223 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.221+0000 7fd46b912640 10 monclient: init 2024-01-23T07:33:21.223 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:21.223 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient: _add_conns ranks=[2,0,4,3,1] 2024-01-23T07:33:21.223 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd46406c3a0 0x7fd46413f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.223 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient(hunting): picked mon.noname-b con 0x7fd46406c3a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd4640a9e50 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd46413f8b0 0x7fd4641427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient(hunting): picked mon.noname-c con 0x7fd46413f8b0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4640aaef0 con 0x7fd4640a9e50 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46413fd40 con 0x7fd46413f8b0 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd464142ce0 con 0x7fd46406c3a0 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.222+0000 7fd46b912640 10 monclient(hunting): authenticate will time out at 2408.580359s 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.223+0000 7fd468ead640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fd4640a9e50 0x7fd464142090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:32888/0 (socket says 172.21.15.116:32888) 2024-01-23T07:33:21.224 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.223+0000 7fd468ead640 1 -- 172.21.15.116:0/444647871 learned_addr learned my addr 172.21.15.116:0/444647871 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:21.226 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.226+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88357843 0 0) 0x7fd4640aaef0 con 0x7fd4640a9e50 2024-01-23T07:33:21.226 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.226+0000 7fd45bfff640 10 monclient(hunting): _negotiate 2024-01-23T07:33:21.226 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.226+0000 7fd45bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:21.226 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.226+0000 7fd45bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:21.226 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.226+0000 7fd45bfff640 10 monclient(hunting): my global_id is 4260 2024-01-23T07:33:21.226 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.226+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd450003520 con 0x7fd4640a9e50 2024-01-23T07:33:21.232 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42814273 0 0) 0x7fd450003520 con 0x7fd4640a9e50 2024-01-23T07:33:21.232 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd46406c3a0 msgr2=0x7fd46413f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:21.232 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd46406c3a0 0x7fd46413f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.232 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 >> v2:172.21.15.173:3300/0 conn(0x7fd46413f8b0 msgr2=0x7fd4641427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 --2- 172.21.15.116:0/444647871 >> v2:172.21.15.173:3300/0 conn(0x7fd46413f8b0 0x7fd4641427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 monclient: found mon.noname-a-legacy 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.116:6789/0 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4640ab1d0 con 0x7fd4640a9e50 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: _finish_auth 0 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd46b912640 5 monclient: authenticate success, global_id 4260 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd46b912640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4041568432 0 0) 0x7fd454001670 con 0x7fd4640a9e50 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:21.233 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: dump: 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] but i'm connected to v1:172.21.15.116:6789/0, reconnecting 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:21.234 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.231+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 >> v1:172.21.15.116:6789/0 conn(0x7fd4640a9e50 legacy=0x7fd464142090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd46406c3a0 0x7fd450003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): picked mon.c con 0x7fd46406c3a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450004080 0x7fd4500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): picked mon.a con 0x7fd450004080 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004d50 0x7fd4500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): picked mon.b con 0x7fd450004d50 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45000bc30 con 0x7fd450004080 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45000bda0 con 0x7fd450004d50 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45000bf60 con 0x7fd46406c3a0 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:21.235 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd45bfff640 10 monclient(hunting): _finish_auth 0 2024-01-23T07:33:21.236 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.232+0000 7fd46b912640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:21.236 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.234+0000 7fd468ead640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450004080 0x7fd4500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:21.236 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.235+0000 7fd468ead640 10 monclient(hunting): get_auth_request con 0x7fd450004080 auth_method 0 2024-01-23T07:33:21.237 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.235+0000 7fd468ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:21.237 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.235+0000 7fd468ead640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:21.237 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.235+0000 7fd468ead640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:33:21.237 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.236+0000 7fd468ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:21.237 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.236+0000 7fd468ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:21.237 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.236+0000 7fd468ead640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T07:33:21.238 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 10 monclient(hunting): handle_auth_done global_id 4260 payload 293 2024-01-23T07:33:21.238 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 1 -- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd46406c3a0 msgr2=0x7fd450003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:21.238 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd46406c3a0 0x7fd450003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 1 -- 172.21.15.116:0/444647871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004d50 msgr2=0x7fd4500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004d50 0x7fd4500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 10 monclient: _finish_hunting 0 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 1 monclient: found mon.a 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 1 -- 172.21.15.116:0/444647871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450003520 con 0x7fd450004080 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 10 monclient: _finish_auth 0 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 10 monclient: _check_auth_tickets 2024-01-23T07:33:21.239 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.238+0000 7fd468ead640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:21.240 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.240+0000 7fd468ead640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450004080 0x7fd4500047c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c1b0 tx=0x7fd4500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ae12c665f0676c server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454005ad0 con 0x7fd450004080 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 10 monclient: dump: 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.244 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454005c30 con 0x7fd450004080 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 1 -- 172.21.15.116:0/444647871 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45402c8d0 con 0x7fd450004080 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd46b912640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd46b912640 4 set_mon_vals no callback set 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.244+0000 7fd45bfff640 10 monclient: dump: 2024-01-23T07:33:21.245 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:21.246 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:21.248 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 10 monclient: shutdown 2024-01-23T07:33:21.248 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:21.248 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 1 -- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450004080 msgr2=0x7fd4500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:21.248 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 1 --2- 172.21.15.116:0/444647871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd450004080 0x7fd4500047c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c1b0 tx=0x7fd4500057f0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd469eaf640 1 -- 172.21.15.116:0/444647871 reap_dead start 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 1 -- 172.21.15.116:0/444647871 shutdown_connections 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 1 -- 172.21.15.116:0/444647871 >> 172.21.15.116:0/444647871 conn(0x7fd4640b7c20 msgr2=0x7fd4640b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 1 -- 172.21.15.116:0/444647871 shutdown_connections 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 1 -- 172.21.15.116:0/444647871 wait complete. 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 10 monclient: build_initial_monmap 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.245+0000 7fd46b912640 10 monclient: monmap: 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:21.249 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.246+0000 7fd46b912640 1 librados: starting msgr at 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.246+0000 7fd46b912640 1 librados: starting objecter 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.246+0000 7fd46b912640 1 Processor -- start 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.246+0000 7fd46b912640 1 -- start start 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.246+0000 7fd46b912640 1 librados: setting wanted keys 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.246+0000 7fd46b912640 1 librados: calling monclient init 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.246+0000 7fd46b912640 10 monclient: init 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004080 0x7fd4641d7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): picked mon.noname-b con 0x7fd450004080 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:21.250 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4640b0a70 0x7fd464144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): picked mon.noname-a con 0x7fd4640b0a70 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464144cb0 0x7fd4640afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): picked mon.noname-c con 0x7fd464144cb0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4641d85b0 con 0x7fd4640b0a70 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd464143d90 con 0x7fd450004080 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4641d7b90 con 0x7fd464144cb0 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.247+0000 7fd46b912640 10 monclient(hunting): authenticate will time out at 2408.605429s 2024-01-23T07:33:21.251 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.248+0000 7fd4696ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004080 0x7fd4641d7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd468ead640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4640b0a70 0x7fd464144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd4696ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004080 0x7fd4641d7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:56864/0 (socket says 172.21.15.116:56864) 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd4696ae640 1 -- 172.21.15.116:0/2307869005 learned_addr learned my addr 172.21.15.116:0/2307869005 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd4696ae640 10 monclient(hunting): get_auth_request con 0x7fd450004080 auth_method 0 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd4696ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd4696ae640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd4696ae640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd468ead640 10 monclient(hunting): get_auth_request con 0x7fd4640b0a70 auth_method 0 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd468ead640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:21.253 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd468ead640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.249+0000 7fd468ead640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.250+0000 7fd468ead640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.250+0000 7fd468ead640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.250+0000 7fd468ead640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.250+0000 7fd4696ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.250+0000 7fd4696ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.250+0000 7fd4696ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 10 monclient(hunting): handle_auth_done global_id 4252 payload 824 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 1 -- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464144cb0 msgr2=0x7fd4640afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464144cb0 0x7fd4640afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 1 -- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4640b0a70 msgr2=0x7fd464144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4640b0a70 0x7fd464144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 10 monclient: _finish_hunting 0 2024-01-23T07:33:21.254 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 1 monclient: found mon.noname-b 2024-01-23T07:33:21.255 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:21.255 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:21.255 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.253+0000 7fd4696ae640 1 -- 172.21.15.116:0/2307869005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464145ed0 con 0x7fd450004080 2024-01-23T07:33:21.255 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.255+0000 7fd4696ae640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004080 0x7fd4641d7620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd46000b550 tx=0x7fd46000ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:21.255 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.255+0000 7fd459ffb640 10 client.?.objecter ms_handle_connect 0x7fd450004080 2024-01-23T07:33:21.255 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.255+0000 7fd459ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:21.259 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 1 -- 172.21.15.116:0/2307869005 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460010890 con 0x7fd450004080 2024-01-23T07:33:21.259 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: dump: 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:21.260 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: _finish_auth 0 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 1 -- 172.21.15.116:0/2307869005 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4600109f0 con 0x7fd450004080 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 5 monclient: authenticate success, global_id 4252 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 10 monclient: _renew_subs 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4641461e0 con 0x7fd450004080 2024-01-23T07:33:21.261 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 1 -- 172.21.15.116:0/2307869005 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460010d80 con 0x7fd450004080 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd459ffb640 10 monclient: dump: 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:21.262 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd45b7fe640 4 set_mon_vals no callback set 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 10 client.4252.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 10 monclient: _renew_subs 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:21.263 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd464145320 con 0x7fd450004080 2024-01-23T07:33:21.264 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.259+0000 7fd46b912640 1 librados: init done 2024-01-23T07:33:21.264 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.260+0000 7fd46b912640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:21.264 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.260+0000 7fd46b912640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:21.264 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.260+0000 7fd46b912640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:21.265 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.260+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd464143f20 con 0x7fd450004080 2024-01-23T07:33:21.279 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.278+0000 7fd459ffb640 1 -- 172.21.15.116:0/2307869005 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd460023480 con 0x7fd450004080 2024-01-23T07:33:21.279 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.279+0000 7fd459ffb640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd44806c8b0 0x7fd44806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:21.279 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.279+0000 7fd468ead640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd44806c8b0 0x7fd44806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:21.280 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.279+0000 7fd468ead640 10 monclient: get_auth_request con 0x7fd44806c8b0 auth_method 0 2024-01-23T07:33:21.280 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.279+0000 7fd468ead640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd44806c8b0 0x7fd44806ed70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd454034000 tx=0x7fd454007000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:21.280 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.279+0000 7fd459ffb640 10 client.4252.objecter ms_handle_connect 0x7fd44806c8b0 2024-01-23T07:33:21.282 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.281+0000 7fd459ffb640 1 -- 172.21.15.116:0/2307869005 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4017+0+0 (secure 0 0 0) 0x7fd460058680 con 0x7fd450004080 2024-01-23T07:33:21.282 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.281+0000 7fd459ffb640 10 client.4252.objecter ms_dispatch 0x7fd464000b90 osd_map(17..17 src has 1..17) v4 2024-01-23T07:33:21.282 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.281+0000 7fd459ffb640 3 client.4252.objecter handle_osd_map got epochs [17,17] > 0 2024-01-23T07:33:21.282 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.281+0000 7fd459ffb640 3 client.4252.objecter handle_osd_map decoding full epoch 17 2024-01-23T07:33:21.282 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.281+0000 7fd459ffb640 20 client.4252.objecter dump_active .. 0 homeless 2024-01-23T07:33:21.455 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:33:21.441+0000 14459640 -1 osd.4 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:21.534 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.534+0000 7fd459ffb640 1 -- 172.21.15.116:0/2307869005 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd4600549c0 con 0x7fd450004080 2024-01-23T07:33:21.534 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.534+0000 7fd459ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:21.535 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.534+0000 7fd459ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:21.582 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:21.108+0000 5dc2480 -1 bdev(0x166d9e40 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 2 2024-01-23T07:33:21.744 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.744+0000 7fd46b912640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:21.744 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.744+0000 7fd46b912640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:21.745 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.744+0000 7fd46b912640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:21.745 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.744+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd46413f320 con 0x7fd450004080 2024-01-23T07:33:21.937 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.937+0000 7fd459ffb640 1 -- 172.21.15.116:0/2307869005 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11407 (secure 0 0 0) 0x7fd46001e020 con 0x7fd450004080 2024-01-23T07:33:21.938 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.937+0000 7fd459ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:21.938 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.937+0000 7fd459ffb640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:21.938 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:33:21.938 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":17,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:33:17.063898+0000","last_up_change":"2024-01-23T07:33:15.377009+0000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T07:33:12.781798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6803","nonce":950064745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6805","nonce":950064745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6809","nonce":950064745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6807","nonce":950064745}]},"public_addr":"172.21.15.116:6803/950064745","cluster_addr":"172.21.15.116:6805/950064745","heartbeat_back_addr":"172.21.15.116:6809/950064745","heartbeat_front_addr":"172.21.15.116:6807/950064745","state":["exists","up"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6827","nonce":2848377313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6829","nonce":2848377313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6833","nonce":2848377313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6831","nonce":2848377313}]},"public_addr":"172.21.15.116:6827/2848377313","cluster_addr":"172.21.15.116:6829/2848377313","heartbeat_back_addr":"172.21.15.116:6833/2848377313","heartbeat_front_addr":"172.21.15.116:6831/2848377313","state":["exists","up"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6801","nonce":1137022367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6803","nonce":1137022367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6809","nonce":1137022367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6805","nonce":1137022367}]},"public_addr":"172.21.15.173:6801/1137022367","cluster_addr":"172.21.15.173:6803/1137022367","heartbeat_back_addr":"172.21.15.173:6809/1137022367","heartbeat_front_addr":"172.21.15.173:6805/1137022367","state":["exists","up"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6817","nonce":548415989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6819","nonce":548415989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6823","nonce":548415989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6821","nonce":548415989}]},"public_addr":"172.21.15.173:6817/548415989","cluster_addr":"172.21.15.173:6819/548415989","heartbeat_back_addr":"172.21.15.173:6823/548415989","heartbeat_front_addr":"172.21.15.173:6821/548415989","state":["exists","up"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6825","nonce":1205985563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6827","nonce":1205985563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6831","nonce":1205985563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6829","nonce":1205985563}]},"public_addr":"172.21.15.173:6825/1205985563","cluster_addr":"172.21.15.173:6827/1205985563","heartbeat_back_addr":"172.21.15.173:6831/1205985563","heartbeat_front_addr":"172.21.15.173:6829/1205985563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.751411+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.226283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.105254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.482296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.067044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:33:21.942 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 10 librados: watch_flush enter 2024-01-23T07:33:21.943 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 10 librados: watch_flush exit 2024-01-23T07:33:21.943 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 20 client.4252.objecter shutdown clearing up homeless session... 2024-01-23T07:33:21.943 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 10 client.4252.objecter successfully canceled tick 2024-01-23T07:33:21.943 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd44806c8b0 msgr2=0x7fd44806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:21.943 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd44806c8b0 0x7fd44806ed70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd454034000 tx=0x7fd454007000 comp rx=0 tx=0).stop 2024-01-23T07:33:21.944 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 10 monclient: shutdown 2024-01-23T07:33:21.944 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:21.944 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004080 msgr2=0x7fd4641d7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:21.944 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004080 0x7fd4641d7620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd46000b550 tx=0x7fd46000ba10 comp rx=0 tx=0).stop 2024-01-23T07:33:21.944 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 shutdown_connections 2024-01-23T07:33:21.945 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd44806c8b0 0x7fd44806ed70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.945 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd464144cb0 0x7fd4640afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.945 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd4640b0a70 0x7fd464144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.945 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 --2- 172.21.15.116:0/2307869005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd450004080 0x7fd4641d7620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:21.946 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 >> 172.21.15.116:0/2307869005 conn(0x7fd4640b7c20 msgr2=0x7fd4641398c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:21.946 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 shutdown_connections 2024-01-23T07:33:21.946 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 -- 172.21.15.116:0/2307869005 wait complete. 2024-01-23T07:33:21.946 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:21.940+0000 7fd46b912640 1 librados: shutdown 2024-01-23T07:33:21.951 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-01-23T07:33:22.583 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:22.579+0000 ae7c640 -1 osd.1 0 waiting for initial osdmap 2024-01-23T07:33:22.774 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:22.770+0000 c692640 -1 osd.3 0 waiting for initial osdmap 2024-01-23T07:33:23.121 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:33:23.107+0000 14459640 -1 osd.1 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:23.249 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:33:23.237+0000 14459640 -1 osd.3 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:33:25.831 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:14.210 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:25.886 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:14.265 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:25.909 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:14.245 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:25.947 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:14.327 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:25.963 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:14.299 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:26.007 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:14.387 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:26.172 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:14.551 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:26.202 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:14.538 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:26.299 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:14.679 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:28.761 DEBUG:teuthology.orchestra.run.smithi116:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-23T07:33:28.850 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.851+0000 7f90c0c10640 10 monclient: get_monmap_and_config 2024-01-23T07:33:28.850 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.851+0000 7f90c0c10640 10 monclient: build_initial_monmap 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.851+0000 7f90c0c10640 10 monclient: monmap: 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:33:28.851212+0000 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:33:28.851212+0000 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:28.851 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.851+0000 7f90c0c10640 1 Processor -- start 2024-01-23T07:33:28.852 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.851+0000 7f90c0c10640 1 -- start start 2024-01-23T07:33:28.852 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.851+0000 7f90c0c10640 10 monclient: init 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient: _add_conns ranks=[4,3,2,0,1] 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f90bc06c310 0x7f90bc0b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): picked mon.noname-c con 0x7f90bc06c310 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f90bc13f370 0x7f90bc13f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): picked mon.noname-a con 0x7f90bc13f370 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc142190 0x7f90bc1425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): picked mon.noname-b con 0x7f90bc142190 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc13fd20 con 0x7f90bc13f370 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc06c6f0 con 0x7f90bc06c310 2024-01-23T07:33:28.855 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0aae80 con 0x7f90bc142190 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90c0c10640 10 monclient(hunting): authenticate will time out at 2416.209623s 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.852+0000 7f90bad9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc142190 0x7f90bc1425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90b9d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f90bc13f370 0x7f90bc13f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90ba59c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f90bc06c310 0x7f90bc0b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90bad9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc142190 0x7f90bc1425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40190/0 (socket says 172.21.15.116:40190) 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90bad9d640 1 -- 172.21.15.116:0/3141145181 learned_addr learned my addr 172.21.15.116:0/3141145181 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90bad9d640 10 monclient(hunting): get_auth_request con 0x7f90bc142190 auth_method 0 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90bad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90bad9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90bad9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:28.856 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90ba59c640 10 monclient(hunting): get_auth_request con 0x7f90bc06c310 auth_method 0 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90ba59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90ba59c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90ba59c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90b9d9b640 10 monclient(hunting): get_auth_request con 0x7f90bc13f370 auth_method 0 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90b9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90b9d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.853+0000 7f90b9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90ba59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90ba59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90ba59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90bad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90bad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90bad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90b9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:28.857 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90b9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.854+0000 7f90b9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 10 monclient(hunting): handle_auth_done global_id 4255 payload 274 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 1 -- 172.21.15.116:0/3141145181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc142190 msgr2=0x7f90bc1425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 1 --2- 172.21.15.116:0/3141145181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc142190 0x7f90bc1425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 1 -- 172.21.15.116:0/3141145181 >> v2:172.21.15.116:3300/0 conn(0x7f90bc13f370 msgr2=0x7f90bc13f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 1 --2- 172.21.15.116:0/3141145181 >> v2:172.21.15.116:3300/0 conn(0x7f90bc13f370 0x7f90bc13f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 1 monclient: found mon.noname-c 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:28.858 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.855+0000 7f90ba59c640 1 -- 172.21.15.116:0/3141145181 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc0a9f40 con 0x7f90bc06c310 2024-01-23T07:33:28.859 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.857+0000 7f90ba59c640 1 --2- 172.21.15.116:0/3141145181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc06c310 0x7f90bc0b3840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f90bc06c870 tx=0x7f90ac02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7c4a1fbbdbd9089 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:28.860 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 1 -- 172.21.15.116:0/3141145181 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac02cbc0 con 0x7f90bc06c310 2024-01-23T07:33:28.860 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:28.860 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: dump: 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: _finish_auth 0 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: _check_auth_tickets 2024-01-23T07:33:28.861 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 1 -- 172.21.15.116:0/3141145181 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac02cd20 con 0x7f90bc06c310 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 1 -- 172.21.15.116:0/3141145181 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac034660 con 0x7f90bc06c310 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90b959a640 10 monclient: dump: 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:28.862 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:28.863 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:28.863 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:28.863 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90c0c10640 5 monclient: authenticate success, global_id 4255 2024-01-23T07:33:28.863 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90c0c10640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:28.863 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.861+0000 7f90c0c10640 4 set_mon_vals no callback set 2024-01-23T07:33:28.866 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 10 monclient: shutdown 2024-01-23T07:33:28.866 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 -- 172.21.15.116:0/3141145181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc06c310 msgr2=0x7f90bc0b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 --2- 172.21.15.116:0/3141145181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc06c310 0x7f90bc0b3840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f90bc06c870 tx=0x7f90ac02be10 comp rx=0 tx=0).stop 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 -- 172.21.15.116:0/3141145181 shutdown_connections 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 --2- 172.21.15.116:0/3141145181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc142190 0x7f90bc1425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 --2- 172.21.15.116:0/3141145181 >> v2:172.21.15.116:3300/0 conn(0x7f90bc13f370 0x7f90bc13f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 --2- 172.21.15.116:0/3141145181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc06c310 0x7f90bc0b3840 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 -- 172.21.15.116:0/3141145181 >> 172.21.15.116:0/3141145181 conn(0x7f90bc0b79d0 msgr2=0x7f90bc0b7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 -- 172.21.15.116:0/3141145181 shutdown_connections 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.862+0000 7f90c0c10640 1 -- 172.21.15.116:0/3141145181 wait complete. 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 10 monclient: build_initial_monmap 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 10 monclient: monmap: 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:epoch 0 2024-01-23T07:33:28.867 INFO:teuthology.misc.health.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:created 0.000000 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 1 librados: starting msgr at 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 1 librados: starting objecter 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 1 Processor -- start 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 1 -- start start 2024-01-23T07:33:28.868 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 1 librados: setting wanted keys 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 1 librados: calling monclient init 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.863+0000 7f90c0c10640 10 monclient: init 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc06c310 0x7f90bc0b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): picked mon.noname-c con 0x7f90bc06c310 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc13f370 0x7f90bc143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): picked mon.noname-b con 0x7f90bc13f370 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc142190 0x7f90bc1da3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): picked mon.noname-a con 0x7f90bc142190 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc143bd0 con 0x7f90bc142190 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:28.869 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1438d0 con 0x7f90bc13f370 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc1440f0 con 0x7f90bc06c310 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90c0c10640 10 monclient(hunting): authenticate will time out at 2416.221448s 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90bad9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc142190 0x7f90bc1da3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90ba59c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc06c310 0x7f90bc0b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.864+0000 7f90b9d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc13f370 0x7f90bc143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc06c310 0x7f90bc0b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40196/0 (socket says 172.21.15.116:40196) 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 1 -- 172.21.15.116:0/513726240 learned_addr learned my addr 172.21.15.116:0/513726240 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 10 monclient(hunting): get_auth_request con 0x7f90bc06c310 auth_method 0 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90bad9d640 10 monclient(hunting): get_auth_request con 0x7f90bc142190 auth_method 0 2024-01-23T07:33:28.870 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90bad9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90bad9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90bad9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90b9d9b640 10 monclient(hunting): get_auth_request con 0x7f90bc13f370 auth_method 0 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90b9d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90b9d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90b9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90ba59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90b9d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90b9d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90b9d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90bad9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:28.871 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90bad9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:28.872 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.865+0000 7f90bad9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 10 monclient(hunting): handle_auth_done global_id 4258 payload 824 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 1 -- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc06c310 msgr2=0x7f90bc0b6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc06c310 0x7f90bc0b6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 1 -- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc142190 msgr2=0x7f90bc1da3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc142190 0x7f90bc1da3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 1 monclient: found mon.noname-b 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.868+0000 7f90b9d9b640 1 -- 172.21.15.116:0/513726240 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac009a70 con 0x7f90bc13f370 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.871+0000 7f90b9d9b640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc13f370 0x7f90bc143390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e850 tx=0x7f90b000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.871+0000 7f90aaffd640 10 client.?.objecter ms_handle_connect 0x7f90bc13f370 2024-01-23T07:33:28.873 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.871+0000 7f90aaffd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 1 -- 172.21.15.116:0/513726240 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b00095b0 con 0x7f90bc13f370 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: dump: 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:28.875 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 1 -- 172.21.15.116:0/513726240 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b000c940 con 0x7f90bc13f370 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 1 -- 172.21.15.116:0/513726240 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000ccd0 con 0x7f90bc13f370 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90aaffd640 10 monclient: dump: 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:epoch 1 2024-01-23T07:33:28.876 INFO:teuthology.misc.health.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr: 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 5 monclient: authenticate success, global_id 4258 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 10 monclient: _renew_subs 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90b8d99640 4 set_mon_vals no callback set 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc1462c0 con 0x7f90bc13f370 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 10 client.4258.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:28.877 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 10 monclient: _renew_subs 2024-01-23T07:33:28.878 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:28.878 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc1daae0 con 0x7f90bc13f370 2024-01-23T07:33:28.878 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.874+0000 7f90c0c10640 1 librados: init done 2024-01-23T07:33:28.878 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.875+0000 7f90c0c10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:28.878 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.875+0000 7f90c0c10640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:28.878 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.875+0000 7f90c0c10640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:28.878 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:28.875+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc143d40 con 0x7f90bc13f370 2024-01-23T07:33:29.116 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.116+0000 7f90aaffd640 1 -- 172.21.15.116:0/513726240 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f90b0013470 con 0x7f90bc13f370 2024-01-23T07:33:29.116 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.117+0000 7f90aaffd640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f909c06c8b0 0x7f909c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:29.116 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.117+0000 7f90ba59c640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f909c06c8b0 0x7f909c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:29.116 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.117+0000 7f90ba59c640 10 monclient: get_auth_request con 0x7f909c06c8b0 auth_method 0 2024-01-23T07:33:29.117 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.117+0000 7f90ba59c640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f909c06c8b0 0x7f909c06ed70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90ac000f80 tx=0x7f90ac030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:29.117 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.117+0000 7f90aaffd640 10 client.4258.objecter ms_handle_connect 0x7f909c06c8b0 2024-01-23T07:33:29.118 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.119+0000 7f90aaffd640 1 -- 172.21.15.116:0/513726240 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f90b000ce30 con 0x7f90bc13f370 2024-01-23T07:33:29.118 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.119+0000 7f90aaffd640 10 client.4258.objecter ms_dispatch 0x7f90bc000b90 osd_map(21..21 src has 1..21) v4 2024-01-23T07:33:29.118 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.119+0000 7f90aaffd640 3 client.4258.objecter handle_osd_map got epochs [21,21] > 0 2024-01-23T07:33:29.118 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.119+0000 7f90aaffd640 3 client.4258.objecter handle_osd_map decoding full epoch 21 2024-01-23T07:33:29.118 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.119+0000 7f90aaffd640 20 client.4258.objecter dump_active .. 0 homeless 2024-01-23T07:33:29.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.130+0000 7f90aaffd640 1 -- 172.21.15.116:0/513726240 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f90b0054e80 con 0x7f90bc13f370 2024-01-23T07:33:29.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.130+0000 7f90aaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:29.129 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.130+0000 7f90aaffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:29.301 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.302+0000 7f90c0c10640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:29.302 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.302+0000 7f90c0c10640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:29.302 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.302+0000 7f90c0c10640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:29.302 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.302+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90bc1dad60 con 0x7f90bc13f370 2024-01-23T07:33:29.326 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.326+0000 7f90aaffd640 1 -- 172.21.15.116:0/513726240 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+12876 (secure 0 0 0) 0x7f90b0021090 con 0x7f90bc13f370 2024-01-23T07:33:29.326 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.326+0000 7f90aaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:29.326 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.326+0000 7f90aaffd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:29.326 INFO:teuthology.misc.health.smithi116.stdout: 2024-01-23T07:33:29.326 INFO:teuthology.misc.health.smithi116.stdout:{"epoch":21,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:33:26.165918+0000","last_up_change":"2024-01-23T07:33:23.990340+0000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T07:33:12.781798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6803","nonce":950064745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6805","nonce":950064745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6809","nonce":950064745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6807","nonce":950064745}]},"public_addr":"172.21.15.116:6803/950064745","cluster_addr":"172.21.15.116:6805/950064745","heartbeat_back_addr":"172.21.15.116:6809/950064745","heartbeat_front_addr":"172.21.15.116:6807/950064745","state":["exists","up"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6811","nonce":745967066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6813","nonce":745967066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6817","nonce":745967066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6815","nonce":745967066}]},"public_addr":"172.21.15.116:6811/745967066","cluster_addr":"172.21.15.116:6813/745967066","heartbeat_back_addr":"172.21.15.116:6817/745967066","heartbeat_front_addr":"172.21.15.116:6815/745967066","state":["exists","up"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6827","nonce":2848377313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6829","nonce":2848377313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6833","nonce":2848377313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6831","nonce":2848377313}]},"public_addr":"172.21.15.116:6827/2848377313","cluster_addr":"172.21.15.116:6829/2848377313","heartbeat_back_addr":"172.21.15.116:6833/2848377313","heartbeat_front_addr":"172.21.15.116:6831/2848377313","state":["exists","up"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6819","nonce":1332739445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6821","nonce":1332739445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6825","nonce":1332739445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6823","nonce":1332739445}]},"public_addr":"172.21.15.116:6819/1332739445","cluster_addr":"172.21.15.116:6821/1332739445","heartbeat_back_addr":"172.21.15.116:6825/1332739445","heartbeat_front_addr":"172.21.15.116:6823/1332739445","state":["exists","up"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6807","nonce":3961996474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6811","nonce":3961996474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6815","nonce":3961996474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6813","nonce":3961996474}]},"public_addr":"172.21.15.173:6807/3961996474","cluster_addr":"172.21.15.173:6811/3961996474","heartbeat_back_addr":"172.21.15.173:6815/3961996474","heartbeat_front_addr":"172.21.15.173:6813/3961996474","state":["exists","up"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6801","nonce":1137022367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6803","nonce":1137022367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6809","nonce":1137022367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6805","nonce":1137022367}]},"public_addr":"172.21.15.173:6801/1137022367","cluster_addr":"172.21.15.173:6803/1137022367","heartbeat_back_addr":"172.21.15.173:6809/1137022367","heartbeat_front_addr":"172.21.15.173:6805/1137022367","state":["exists","up"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6817","nonce":548415989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6819","nonce":548415989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6823","nonce":548415989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6821","nonce":548415989}]},"public_addr":"172.21.15.173:6817/548415989","cluster_addr":"172.21.15.173:6819/548415989","heartbeat_back_addr":"172.21.15.173:6823/548415989","heartbeat_front_addr":"172.21.15.173:6821/548415989","state":["exists","up"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6825","nonce":1205985563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6827","nonce":1205985563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6831","nonce":1205985563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6829","nonce":1205985563}]},"public_addr":"172.21.15.173:6825/1205985563","cluster_addr":"172.21.15.173:6827/1205985563","heartbeat_back_addr":"172.21.15.173:6831/1205985563","heartbeat_front_addr":"172.21.15.173:6829/1205985563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.751411+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.227879+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.226283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.349783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.990738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.105254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.482296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.067044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:33:29.328 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 10 librados: watch_flush enter 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 10 librados: watch_flush exit 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 20 client.4258.objecter shutdown clearing up homeless session... 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 10 client.4258.objecter successfully canceled tick 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f909c06c8b0 msgr2=0x7f909c06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f909c06c8b0 0x7f909c06ed70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90ac000f80 tx=0x7f90ac030000 comp rx=0 tx=0).stop 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 10 monclient: shutdown 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc13f370 msgr2=0x7f90bc143390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc13f370 0x7f90bc143390 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e850 tx=0x7f90b000ed10 comp rx=0 tx=0).stop 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 shutdown_connections 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f909c06c8b0 0x7f909c06ed70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.329 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc142190 0x7f90bc1da3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.330 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90bc13f370 0x7f90bc143390 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.330 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 --2- 172.21.15.116:0/513726240 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f90bc06c310 0x7f90bc0b6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.330 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 >> 172.21.15.116:0/513726240 conn(0x7f90bc0b79d0 msgr2=0x7f90bc13e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:29.330 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 shutdown_connections 2024-01-23T07:33:29.330 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 -- 172.21.15.116:0/513726240 wait complete. 2024-01-23T07:33:29.330 INFO:teuthology.misc.health.smithi116.stderr:2024-01-23T07:33:29.328+0000 7f90c0c10640 1 librados: shutdown 2024-01-23T07:33:29.337 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-23T07:33:29.338 INFO:tasks.ceph:Creating RBD pool 2024-01-23T07:33:29.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd pool create rbd 8 2024-01-23T07:33:29.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.438+0000 7fbd8298d640 10 monclient: get_monmap_and_config 2024-01-23T07:33:29.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.438+0000 7fbd8298d640 10 monclient: build_initial_monmap 2024-01-23T07:33:29.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.438+0000 7fbd8298d640 10 monclient: monmap: 2024-01-23T07:33:29.437 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:29.437 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:29.438443+0000 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:29.438443+0000 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:29.438 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.438+0000 7fbd8298d640 1 Processor -- start 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 1 -- start start 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient: init 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbd7c0a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd7c13faa0 0x7fbd7c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient(hunting): picked mon.noname-c con 0x7fbd7c13faa0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c145600 0x7fbd7c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient(hunting): picked mon.noname-b con 0x7fbd7c145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7c0aac10 con 0x7fbd7c0a96e0 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd7c0a9e00 con 0x7fbd7c13faa0 2024-01-23T07:33:29.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c0a9ac0 con 0x7fbd7c145600 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.439+0000 7fbd8298d640 10 monclient(hunting): authenticate will time out at 2416.796884s 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd80f2a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c145600 0x7fbd7c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd7b7fe640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbd7c13faa0 0x7fbd7c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd7bfff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fbd7c0a96e0 0x7fbd7c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48452/0 (socket says 172.21.15.116:48452) 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd7bfff640 1 -- 172.21.15.116:0/694589301 learned_addr learned my addr 172.21.15.116:0/694589301 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd7b7fe640 10 monclient(hunting): get_auth_request con 0x7fbd7c13faa0 auth_method 0 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd7b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd80f2a640 10 monclient(hunting): get_auth_request con 0x7fbd7c145600 auth_method 0 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd80f2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:29.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd80f2a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:29.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.440+0000 7fbd80f2a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:29.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.441+0000 7fbd7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:29.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.441+0000 7fbd7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:29.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.441+0000 7fbd7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:29.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.441+0000 7fbd80f2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:29.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.441+0000 7fbd80f2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:29.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.441+0000 7fbd80f2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 10 monclient(hunting): handle_auth_done global_id 4261 payload 274 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 1 -- 172.21.15.116:0/694589301 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c145600 msgr2=0x7fbd7c145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 1 --2- 172.21.15.116:0/694589301 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c145600 0x7fbd7c145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 1 -- 172.21.15.116:0/694589301 >> v1:172.21.15.116:6789/0 conn(0x7fbd7c0a96e0 legacy=0x7fbd7c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 1 monclient: found mon.noname-c 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.442+0000 7fbd7b7fe640 1 -- 172.21.15.116:0/694589301 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c0aae80 con 0x7fbd7c13faa0 2024-01-23T07:33:29.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.444+0000 7fbd7b7fe640 1 --2- 172.21.15.116:0/694589301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c13faa0 0x7fbd7c0b1850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009790 tx=0x7fbd7002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=651b829fcdcd108f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 1 -- 172.21.15.116:0/694589301 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70031800 con 0x7fbd7c13faa0 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: dump: 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:29.448 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: _finish_auth 0 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 1 -- 172.21.15.116:0/694589301 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70031960 con 0x7fbd7c13faa0 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 5 monclient: authenticate success, global_id 4261 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 4 set_mon_vals no callback set 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 1 -- 172.21.15.116:0/694589301 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70031cf0 con 0x7fbd7c13faa0 2024-01-23T07:33:29.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd7affd640 10 monclient: dump: 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 10 monclient: shutdown 2024-01-23T07:33:29.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 1 -- 172.21.15.116:0/694589301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c13faa0 msgr2=0x7fbd7c0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 1 --2- 172.21.15.116:0/694589301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c13faa0 0x7fbd7c0b1850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009790 tx=0x7fbd7002b8a0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 1 -- 172.21.15.116:0/694589301 shutdown_connections 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 1 --2- 172.21.15.116:0/694589301 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c145600 0x7fbd7c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 1 --2- 172.21.15.116:0/694589301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c13faa0 0x7fbd7c0b1850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.448+0000 7fbd8298d640 1 -- 172.21.15.116:0/694589301 >> 172.21.15.116:0/694589301 conn(0x7fbd7c0b7bb0 msgr2=0x7fbd7c0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.449+0000 7fbd8298d640 1 -- 172.21.15.116:0/694589301 shutdown_connections 2024-01-23T07:33:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.449+0000 7fbd8298d640 1 -- 172.21.15.116:0/694589301 wait complete. 2024-01-23T07:33:29.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.449+0000 7fbd8298d640 10 monclient: build_initial_monmap 2024-01-23T07:33:29.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.449+0000 7fbd8298d640 10 monclient: monmap: 2024-01-23T07:33:29.454 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:29.454 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:29.454 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.449+0000 7fbd8298d640 1 librados: starting msgr at 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.449+0000 7fbd8298d640 1 librados: starting objecter 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 Processor -- start 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 -- start start 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 librados: setting wanted keys 2024-01-23T07:33:29.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 librados: calling monclient init 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient: init 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd7c0a96e0 0x7fbd7c138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): picked mon.noname-a con 0x7fbd7c0a96e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c13faa0 0x7fbd7c1361e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): picked mon.noname-c con 0x7fbd7c13faa0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c145600 0x7fbd7c136720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): picked mon.noname-b con 0x7fbd7c145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c137fa0 con 0x7fbd7c0a96e0 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c136c60 con 0x7fbd7c145600 2024-01-23T07:33:29.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c1359c0 con 0x7fbd7c13faa0 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.450+0000 7fbd8298d640 10 monclient(hunting): authenticate will time out at 2416.807982s 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7b7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c13faa0 0x7fbd7c1361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd7c0a96e0 0x7fbd7c138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd80f2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c145600 0x7fbd7c136720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7b7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c13faa0 0x7fbd7c1361e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40228/0 (socket says 172.21.15.116:40228) 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7b7fe640 1 -- 172.21.15.116:0/2761858666 learned_addr learned my addr 172.21.15.116:0/2761858666 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7b7fe640 10 monclient(hunting): get_auth_request con 0x7fbd7c13faa0 auth_method 0 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:29.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7bfff640 10 monclient(hunting): get_auth_request con 0x7fbd7c0a96e0 auth_method 0 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd80f2a640 10 monclient(hunting): get_auth_request con 0x7fbd7c145600 auth_method 0 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd80f2a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd80f2a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.451+0000 7fbd80f2a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd7b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd7b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd7b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd7bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd7bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd7bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd80f2a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:29.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd80f2a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.452+0000 7fbd80f2a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 10 monclient(hunting): handle_auth_done global_id 4264 payload 824 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 1 -- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c13faa0 msgr2=0x7fbd7c1361e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c13faa0 0x7fbd7c1361e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 1 -- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd7c0a96e0 msgr2=0x7fbd7c138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd7c0a96e0 0x7fbd7c138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 10 monclient: _finish_hunting 0 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 1 monclient: found mon.noname-b 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:29.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.454+0000 7fbd80f2a640 1 -- 172.21.15.116:0/2761858666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd700093a0 con 0x7fbd7c145600 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.457+0000 7fbd80f2a640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c145600 0x7fbd7c136720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400ebb0 tx=0x7fbd7400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.457+0000 7fbd78ff9640 10 client.?.objecter ms_handle_connect 0x7fbd7c145600 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.457+0000 7fbd78ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 1 -- 172.21.15.116:0/2761858666 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7400cd20 con 0x7fbd7c145600 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: dump: 2024-01-23T07:33:29.461 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: _finish_auth 0 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: _check_auth_tickets 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 1 -- 172.21.15.116:0/2761858666 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7400f040 con 0x7fbd7c145600 2024-01-23T07:33:29.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 1 -- 172.21.15.116:0/2761858666 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740146c0 con 0x7fbd7c145600 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd78ff9640 10 monclient: dump: 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:29.463 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 5 monclient: authenticate success, global_id 4264 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd79ffb640 4 set_mon_vals no callback set 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 10 monclient: _renew_subs 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c1381a0 con 0x7fbd7c145600 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 10 client.4264.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 10 monclient: _renew_subs 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c138e70 con 0x7fbd7c145600 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.460+0000 7fbd8298d640 1 librados: init done 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.461+0000 7fbd8298d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.461+0000 7fbd8298d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.461+0000 7fbd8298d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:29.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.461+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd7c067d70 con 0x7fbd7c145600 2024-01-23T07:33:29.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.479+0000 7fbd78ff9640 1 -- 172.21.15.116:0/2761858666 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbd74014820 con 0x7fbd7c145600 2024-01-23T07:33:29.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.480+0000 7fbd78ff9640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd6806c8e0 0x7fbd6806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:29.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.480+0000 7fbd7bfff640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd6806c8e0 0x7fbd6806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:29.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.480+0000 7fbd7bfff640 10 monclient: get_auth_request con 0x7fbd6806c8e0 auth_method 0 2024-01-23T07:33:29.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.480+0000 7fbd7bfff640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd6806c8e0 0x7fbd6806eda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c007fd0 tx=0x7fbd6c007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:29.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.480+0000 7fbd78ff9640 10 client.4264.objecter ms_handle_connect 0x7fbd6806c8e0 2024-01-23T07:33:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.705+0000 7fbd78ff9640 1 -- 172.21.15.116:0/2761858666 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd74059310 con 0x7fbd7c145600 2024-01-23T07:33:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.705+0000 7fbd78ff9640 10 client.4264.objecter ms_dispatch 0x7fbd7c000b90 osd_map(21..21 src has 1..21) v4 2024-01-23T07:33:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.705+0000 7fbd78ff9640 3 client.4264.objecter handle_osd_map got epochs [21,21] > 0 2024-01-23T07:33:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.705+0000 7fbd78ff9640 3 client.4264.objecter handle_osd_map decoding full epoch 21 2024-01-23T07:33:29.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.705+0000 7fbd78ff9640 20 client.4264.objecter dump_active .. 0 homeless 2024-01-23T07:33:29.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.718+0000 7fbd78ff9640 1 -- 172.21.15.116:0/2761858666 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbd74055650 con 0x7fbd7c145600 2024-01-23T07:33:29.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.718+0000 7fbd78ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:29.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.718+0000 7fbd78ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:29.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.894+0000 7fbd8298d640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-01-23T07:33:29.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.894+0000 7fbd8298d640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-01-23T07:33:29.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.894+0000 7fbd8298d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:29.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:29.894+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbd7c04ea10 con 0x7fbd7c145600 2024-01-23T07:33:30.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.906+0000 7fbd78ff9640 1 -- 172.21.15.116:0/2761858666 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v22) v1 ==== 109+0+0 (secure 0 0 0) 0x7fbd74018020 con 0x7fbd7c145600 2024-01-23T07:33:30.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.906+0000 7fbd78ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-01-23T07:33:30.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.906+0000 7fbd78ff9640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-01-23T07:33:30.906 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'rbd' created 2024-01-23T07:33:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 10 librados: watch_flush enter 2024-01-23T07:33:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 10 librados: watch_flush exit 2024-01-23T07:33:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 20 client.4264.objecter shutdown clearing up homeless session... 2024-01-23T07:33:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 10 client.4264.objecter successfully canceled tick 2024-01-23T07:33:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd6806c8e0 msgr2=0x7fbd6806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd6806c8e0 0x7fbd6806eda0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c007fd0 tx=0x7fbd6c007e80 comp rx=0 tx=0).stop 2024-01-23T07:33:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 10 monclient: shutdown 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c145600 msgr2=0x7fbd7c136720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c145600 0x7fbd7c136720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400ebb0 tx=0x7fbd7400c490 comp rx=0 tx=0).stop 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 shutdown_connections 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd6806c8e0 0x7fbd6806eda0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd7c145600 0x7fbd7c136720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd7c13faa0 0x7fbd7c1361e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 --2- 172.21.15.116:0/2761858666 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd7c0a96e0 0x7fbd7c138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 >> 172.21.15.116:0/2761858666 conn(0x7fbd7c0b7bb0 msgr2=0x7fbd7c073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 shutdown_connections 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 -- 172.21.15.116:0/2761858666 wait complete. 2024-01-23T07:33:30.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:30.908+0000 7fbd8298d640 1 librados: shutdown 2024-01-23T07:33:30.918 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.024+0000 7f62e71dd640 10 monclient: get_monmap_and_config 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.024+0000 7f62e71dd640 10 monclient: build_initial_monmap 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.024+0000 7f62e71dd640 10 monclient: monmap: 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:31.025054+0000 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:31.025054+0000 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:31.024 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:31.025 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:31.025 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:31.025 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:31.025 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:31.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.025+0000 7f62e71dd640 1 Processor -- start 2024-01-23T07:33:31.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.025+0000 7f62e71dd640 1 -- start start 2024-01-23T07:33:31.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.025+0000 7f62e71dd640 10 monclient: init 2024-01-23T07:33:31.027 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): picked mon.noname-b con 0x7f62e00b4870 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62e00b41b0 0x7f62e0145b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): picked mon.noname-c con 0x7f62e00b41b0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62e00a9e00 0x7f62e013f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): picked mon.noname-a con 0x7f62e00a9e00 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00b4c50 con 0x7f62e00a9e00 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00aac10 con 0x7f62e00b41b0 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:31.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00aaef0 con 0x7f62e00b4870 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.026+0000 7f62e71dd640 10 monclient(hunting): authenticate will time out at 2418.383966s 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e4f79640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e577a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f62e00a9e00 0x7f62e013f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62d7fff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f62e00b41b0 0x7f62e0145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e4f79640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01455f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40240/0 (socket says 172.21.15.116:40240) 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e4f79640 1 -- 172.21.15.116:0/3267046932 learned_addr learned my addr 172.21.15.116:0/3267046932 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e4f79640 10 monclient(hunting): get_auth_request con 0x7f62e00b4870 auth_method 0 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e4f79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e4f79640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e4f79640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e577a640 10 monclient(hunting): get_auth_request con 0x7f62e00a9e00 auth_method 0 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e577a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:31.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e577a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62e577a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62d7fff640 10 monclient(hunting): get_auth_request con 0x7f62e00b41b0 auth_method 0 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62d7fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.027+0000 7f62d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62e4f79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62e4f79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62e4f79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62e577a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62e577a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:31.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.028+0000 7f62e577a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:31.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 10 monclient(hunting): handle_auth_done global_id 14228 payload 274 2024-01-23T07:33:31.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 1 -- 172.21.15.116:0/3267046932 >> v2:172.21.15.173:3300/0 conn(0x7f62e00b41b0 msgr2=0x7f62e0145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:31.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 1 --2- 172.21.15.116:0/3267046932 >> v2:172.21.15.173:3300/0 conn(0x7f62e00b41b0 0x7f62e0145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:31.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 1 -- 172.21.15.116:0/3267046932 >> v2:172.21.15.116:3300/0 conn(0x7f62e00a9e00 msgr2=0x7f62e013f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:31.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 1 --2- 172.21.15.116:0/3267046932 >> v2:172.21.15.116:3300/0 conn(0x7f62e00a9e00 0x7f62e013f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:31.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 10 monclient: _finish_hunting 0 2024-01-23T07:33:31.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 1 monclient: found mon.noname-b 2024-01-23T07:33:31.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.029+0000 7f62e4f79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:31.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.030+0000 7f62e4f79640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:31.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.030+0000 7f62e4f79640 1 -- 172.21.15.116:0/3267046932 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00ab1d0 con 0x7f62e00b4870 2024-01-23T07:33:31.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.032+0000 7f62e4f79640 1 --2- 172.21.15.116:0/3267046932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01455f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f62e0067430 tx=0x7f62dc02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3500f308cea49545 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 1 -- 172.21.15.116:0/3267046932 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc031870 con 0x7f62e00b4870 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: dump: 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:31.035 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 1 -- 172.21.15.116:0/3267046932 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc0319d0 con 0x7f62e00b4870 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62e71dd640 5 monclient: authenticate success, global_id 14228 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62e71dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62e71dd640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 1 -- 172.21.15.116:0/3267046932 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc031d60 con 0x7f62e00b4870 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62e71dd640 4 set_mon_vals no callback set 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:31.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.035+0000 7f62d77fe640 10 monclient: dump: 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:31.037 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 10 monclient: shutdown 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 -- 172.21.15.116:0/3267046932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 msgr2=0x7f62e01455f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3267046932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01455f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f62e0067430 tx=0x7f62dc02b910 comp rx=0 tx=0).stop 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 -- 172.21.15.116:0/3267046932 shutdown_connections 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3267046932 >> v2:172.21.15.116:3300/0 conn(0x7f62e00a9e00 0x7f62e013f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3267046932 >> v2:172.21.15.173:3300/0 conn(0x7f62e00b41b0 0x7f62e0145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3267046932 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01455f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 -- 172.21.15.116:0/3267046932 >> 172.21.15.116:0/3267046932 conn(0x7f62e0066450 msgr2=0x7f62e0066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 -- 172.21.15.116:0/3267046932 shutdown_connections 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.036+0000 7f62e71dd640 1 -- 172.21.15.116:0/3267046932 wait complete. 2024-01-23T07:33:31.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 10 monclient: build_initial_monmap 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 10 monclient: monmap: 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 1 librados: starting msgr at 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 1 librados: starting objecter 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 1 Processor -- start 2024-01-23T07:33:31.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 1 -- start start 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 1 librados: setting wanted keys 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 1 librados: calling monclient init 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.037+0000 7f62e71dd640 10 monclient: init 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00a9e00 0x7f62e0142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): picked mon.noname-a con 0x7f62e00a9e00 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e00b41b0 0x7f62e00b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): picked mon.noname-b con 0x7f62e00b41b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01d7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): picked mon.noname-c con 0x7f62e00b4870 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00b6ac0 con 0x7f62e00a9e00 2024-01-23T07:33:31.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e01d7750 con 0x7f62e00b41b0 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0142190 con 0x7f62e00b4870 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e71dd640 10 monclient(hunting): authenticate will time out at 2418.395616s 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e4f79640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00a9e00 0x7f62e0142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62e577a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01d7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.038+0000 7f62d7fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e00b41b0 0x7f62e00b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01d7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40244/0 (socket says 172.21.15.116:40244) 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 1 -- 172.21.15.116:0/3511806286 learned_addr learned my addr 172.21.15.116:0/3511806286 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 10 monclient(hunting): get_auth_request con 0x7f62e00b4870 auth_method 0 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:31.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62d7fff640 10 monclient(hunting): get_auth_request con 0x7f62e00b41b0 auth_method 0 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62d7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62d7fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e4f79640 10 monclient(hunting): get_auth_request con 0x7f62e00a9e00 auth_method 0 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e4f79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e4f79640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e4f79640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62e577a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62d7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62d7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:31.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.039+0000 7f62d7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:31.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.040+0000 7f62e4f79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:31.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.040+0000 7f62e4f79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:31.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.040+0000 7f62e4f79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:31.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 10 monclient(hunting): handle_auth_done global_id 4270 payload 824 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 1 -- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 msgr2=0x7f62e01d7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01d7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 1 -- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00a9e00 msgr2=0x7f62e0142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00a9e00 0x7f62e0142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 1 monclient: found mon.noname-b 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.042+0000 7f62d7fff640 1 -- 172.21.15.116:0/3511806286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc0094d0 con 0x7f62e00b41b0 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.044+0000 7f62d7fff640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e00b41b0 0x7f62e00b57a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62d000e850 tx=0x7f62d000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.044+0000 7f62d57fa640 10 client.?.objecter ms_handle_connect 0x7f62e00b41b0 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.044+0000 7f62d57fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:31.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62d57fa640 1 -- 172.21.15.116:0/3511806286 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d00095b0 con 0x7f62e00b41b0 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62d57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62d57fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62d57fa640 10 monclient: dump: 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:31.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62d57fa640 10 monclient: _finish_auth 0 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62d57fa640 10 monclient: _check_auth_tickets 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62d57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 5 monclient: authenticate success, global_id 4270 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 10 monclient: _renew_subs 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e00b7100 con 0x7f62e00b41b0 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 10 client.4270.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 10 monclient: _renew_subs 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e01d8390 con 0x7f62e00b41b0 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.046+0000 7f62e71dd640 1 librados: init done 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.047+0000 7f62e71dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.047+0000 7f62e71dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:31.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.047+0000 7f62e71dd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.047+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e01d7910 con 0x7f62e00b41b0 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.048+0000 7f62d57fa640 1 -- 172.21.15.116:0/3511806286 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d0005990 con 0x7f62e00b41b0 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.048+0000 7f62d57fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.048+0000 7f62d57fa640 1 -- 172.21.15.116:0/3511806286 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d0005d00 con 0x7f62e00b41b0 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.048+0000 7f62d57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.048+0000 7f62d57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.048+0000 7f62d57fa640 10 monclient: dump: 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:31.051 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:31.052 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:31.052 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:31.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.048+0000 7f62d6ffd640 4 set_mon_vals no callback set 2024-01-23T07:33:31.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.295+0000 7f62d57fa640 1 -- 172.21.15.116:0/3511806286 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f62d000c940 con 0x7f62e00b41b0 2024-01-23T07:33:31.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.296+0000 7f62d57fa640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f62cc06c860 0x7f62cc06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:31.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.296+0000 7f62e4f79640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f62cc06c860 0x7f62cc06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:31.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.296+0000 7f62e4f79640 10 monclient: get_auth_request con 0x7f62cc06c860 auth_method 0 2024-01-23T07:33:31.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.296+0000 7f62d57fa640 10 client.4270.objecter ms_handle_connect 0x7f62cc06c860 2024-01-23T07:33:31.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.296+0000 7f62e4f79640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f62cc06c860 0x7f62cc06ed20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62dc036000 tx=0x7f62dc03c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:31.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.301+0000 7f62d57fa640 1 -- 172.21.15.116:0/3511806286 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f62d0058b20 con 0x7f62e00b41b0 2024-01-23T07:33:31.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.301+0000 7f62d57fa640 10 client.4270.objecter ms_dispatch 0x7f62e0000b90 osd_map(22..22 src has 1..22) v4 2024-01-23T07:33:31.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.301+0000 7f62d57fa640 3 client.4270.objecter handle_osd_map got epochs [22,22] > 0 2024-01-23T07:33:31.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.301+0000 7f62d57fa640 3 client.4270.objecter handle_osd_map decoding full epoch 22 2024-01-23T07:33:31.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.301+0000 7f62d57fa640 20 client.4270.objecter dump_active .. 0 homeless 2024-01-23T07:33:31.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.311+0000 7f62d57fa640 1 -- 172.21.15.116:0/3511806286 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f62d0054e60 con 0x7f62e00b41b0 2024-01-23T07:33:31.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.312+0000 7f62d57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:31.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.312+0000 7f62d57fa640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:31.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.560+0000 7f62e71dd640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-01-23T07:33:31.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.560+0000 7f62e71dd640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-01-23T07:33:31.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.560+0000 7f62e71dd640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:31.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.560+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f62e0067d70 con 0x7f62e00b41b0 2024-01-23T07:33:31.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.998+0000 7f62d57fa640 1 -- 172.21.15.116:0/3511806286 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v23) v1 ==== 173+0+0 (secure 0 0 0) 0x7f62d0021020 con 0x7f62e00b41b0 2024-01-23T07:33:31.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.998+0000 7f62d57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-01-23T07:33:31.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:31.998+0000 7f62d57fa640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2024-01-23T07:33:31.998 INFO:teuthology.orchestra.run.smithi116.stderr:enabled application 'rbd' on pool 'rbd' 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 10 librados: watch_flush enter 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 10 librados: watch_flush exit 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 20 client.4270.objecter shutdown clearing up homeless session... 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 10 client.4270.objecter successfully canceled tick 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f62cc06c860 msgr2=0x7f62cc06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f62cc06c860 0x7f62cc06ed20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f62dc036000 tx=0x7f62dc03c040 comp rx=0 tx=0).stop 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 10 monclient: shutdown 2024-01-23T07:33:32.001 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e00b41b0 msgr2=0x7f62e00b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e00b41b0 0x7f62e00b57a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f62d000e850 tx=0x7f62d000ed10 comp rx=0 tx=0).stop 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 shutdown_connections 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f62cc06c860 0x7f62cc06ed20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f62e00b4870 0x7f62e01d7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f62e00b41b0 0x7f62e00b57a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 --2- 172.21.15.116:0/3511806286 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f62e00a9e00 0x7f62e0142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 >> 172.21.15.116:0/3511806286 conn(0x7f62e0066450 msgr2=0x7f62e00b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 shutdown_connections 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 -- 172.21.15.116:0/3511806286 wait complete. 2024-01-23T07:33:32.002 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.001+0000 7f62e71dd640 1 librados: shutdown 2024-01-23T07:33:32.014 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-23T07:33:32.015 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-23T07:33:32.015 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-23T07:33:32.015 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-23T07:33:32.016 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-23T07:33:32.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.116+0000 7f6e65c1d640 10 monclient: get_monmap_and_config 2024-01-23T07:33:32.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.116+0000 7f6e65c1d640 10 monclient: build_initial_monmap 2024-01-23T07:33:32.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.116+0000 7f6e65c1d640 10 monclient: monmap: 2024-01-23T07:33:32.115 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:32.115 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:32.115 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:32.116247+0000 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:32.116247+0000 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:32.116 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:32.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.116+0000 7f6e65c1d640 1 Processor -- start 2024-01-23T07:33:32.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.116+0000 7f6e65c1d640 1 -- start start 2024-01-23T07:33:32.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.116+0000 7f6e65c1d640 10 monclient: init 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient: _add_conns ranks=[1,3,0,4,2] 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6e600a96e0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6e6013faa0 0x7f6e600b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient(hunting): picked mon.noname-a con 0x7f6e6013faa0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6e60145600 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e600aac10 con 0x7f6e60145600 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e600a9ac0 con 0x7f6e600a96e0 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e600a9e00 con 0x7f6e6013faa0 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e65c1d640 10 monclient(hunting): authenticate will time out at 2419.474631s 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.117+0000 7f6e5effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6e6013faa0 0x7f6e600b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:32.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.118+0000 7f6e5f7fe640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f6e600a96e0 0x7f6e6013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42254/0 (socket says 172.21.15.116:42254) 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.118+0000 7f6e5f7fe640 1 -- 172.21.15.116:0/1316585423 learned_addr learned my addr 172.21.15.116:0/1316585423 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.118+0000 7f6e5effd640 10 monclient(hunting): get_auth_request con 0x7f6e6013faa0 auth_method 0 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.118+0000 7f6e5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.118+0000 7f6e5effd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.118+0000 7f6e5effd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.119+0000 7f6e5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.119+0000 7f6e5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:32.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.119+0000 7f6e5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 10 monclient(hunting): handle_auth_done global_id 4284 payload 274 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 1 -- 172.21.15.116:0/1316585423 >> v1:172.21.15.173:6789/0 conn(0x7f6e600a96e0 legacy=0x7f6e6013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 1 -- 172.21.15.116:0/1316585423 >> v1:172.21.15.116:6789/0 conn(0x7f6e60145600 legacy=0x7f6e60145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 1 monclient: found mon.noname-a 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:32.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.121+0000 7f6e5effd640 1 -- 172.21.15.116:0/1316585423 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e600aae80 con 0x7f6e6013faa0 2024-01-23T07:33:32.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.124+0000 7f6e5effd640 1 --2- 172.21.15.116:0/1316585423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6013faa0 0x7f6e600b1850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009790 tx=0x7f6e5002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4833eb297353ec server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 1 -- 172.21.15.116:0/1316585423 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50030610 con 0x7f6e6013faa0 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: dump: 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:32.127 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 1 -- 172.21.15.116:0/1316585423 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50030770 con 0x7f6e6013faa0 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e65c1d640 5 monclient: authenticate success, global_id 4284 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e65c1d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e65c1d640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e65c1d640 4 set_mon_vals no callback set 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 1 -- 172.21.15.116:0/1316585423 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50030b00 con 0x7f6e6013faa0 2024-01-23T07:33:32.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.127+0000 7f6e5e7fc640 10 monclient: dump: 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:32.129 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 10 monclient: shutdown 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 1 -- 172.21.15.116:0/1316585423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6013faa0 msgr2=0x7f6e600b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/1316585423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6013faa0 0x7f6e600b1850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e50009790 tx=0x7f6e5002b960 comp rx=0 tx=0).stop 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 1 -- 172.21.15.116:0/1316585423 shutdown_connections 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/1316585423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e6013faa0 0x7f6e600b1850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 1 -- 172.21.15.116:0/1316585423 >> 172.21.15.116:0/1316585423 conn(0x7f6e600b7bb0 msgr2=0x7f6e600b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 1 -- 172.21.15.116:0/1316585423 shutdown_connections 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.128+0000 7f6e65c1d640 1 -- 172.21.15.116:0/1316585423 wait complete. 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 10 monclient: build_initial_monmap 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 10 monclient: monmap: 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:32.133 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 1 librados: starting msgr at 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 1 librados: starting objecter 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 1 Processor -- start 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 1 -- start start 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 1 librados: setting wanted keys 2024-01-23T07:33:32.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 1 librados: calling monclient init 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.129+0000 7f6e65c1d640 10 monclient: init 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e600a96e0 0x7f6e601dac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): picked mon.noname-a con 0x7f6e600a96e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6013faa0 0x7f6e600b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): picked mon.noname-b con 0x7f6e6013faa0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e60145600 0x7f6e6013b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:32.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): picked mon.noname-c con 0x7f6e60145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e60141c70 con 0x7f6e600a96e0 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6013be50 con 0x7f6e6013faa0 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e600b7870 con 0x7f6e60145600 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e65c1d640 10 monclient(hunting): authenticate will time out at 2419.487563s 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e5f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e600a96e0 0x7f6e601dac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e5ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e60145600 0x7f6e6013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.130+0000 7f6e5effd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6013faa0 0x7f6e600b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e600a96e0 0x7f6e601dac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54422/0 (socket says 172.21.15.116:54422) 2024-01-23T07:33:32.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 1 -- 172.21.15.116:0/2597525743 learned_addr learned my addr 172.21.15.116:0/2597525743 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 10 monclient(hunting): get_auth_request con 0x7f6e600a96e0 auth_method 0 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5ffff640 10 monclient(hunting): get_auth_request con 0x7f6e60145600 auth_method 0 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5ffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5effd640 10 monclient(hunting): get_auth_request con 0x7f6e6013faa0 auth_method 0 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5effd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5effd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:32.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.131+0000 7f6e5ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.132+0000 7f6e5effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.132+0000 7f6e5effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:32.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.132+0000 7f6e5effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 10 monclient(hunting): handle_auth_done global_id 4287 payload 824 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 1 -- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e60145600 msgr2=0x7f6e6013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e60145600 0x7f6e6013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 1 -- 172.21.15.116:0/2597525743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6013faa0 msgr2=0x7f6e600b72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6013faa0 0x7f6e600b72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 1 monclient: found mon.noname-a 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:32.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:32.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.134+0000 7f6e5f7fe640 1 -- 172.21.15.116:0/2597525743 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e500093a0 con 0x7f6e600a96e0 2024-01-23T07:33:32.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.136+0000 7f6e5f7fe640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e600a96e0 0x7f6e601dac10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800cb10 tx=0x7f6e5800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:32.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.136+0000 7f6e57fff640 10 client.?.objecter ms_handle_connect 0x7f6e600a96e0 2024-01-23T07:33:32.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.136+0000 7f6e57fff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:32.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 1 -- 172.21.15.116:0/2597525743 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5800ac70 con 0x7f6e600a96e0 2024-01-23T07:33:32.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:32.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:32.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: dump: 2024-01-23T07:33:32.141 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:32.141 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:32.141 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: _finish_auth 0 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 1 -- 172.21.15.116:0/2597525743 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5800add0 con 0x7f6e600a96e0 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 1 -- 172.21.15.116:0/2597525743 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e58012620 con 0x7f6e600a96e0 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e65c1d640 5 monclient: authenticate success, global_id 4287 2024-01-23T07:33:32.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e65c1d640 10 monclient: _renew_subs 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e65c1d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e60146320 con 0x7f6e600a96e0 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e5dffb640 4 set_mon_vals no callback set 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.140+0000 7f6e57fff640 10 monclient: dump: 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:32.143 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.141+0000 7f6e65c1d640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.141+0000 7f6e65c1d640 10 monclient: _renew_subs 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.141+0000 7f6e65c1d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.141+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e60140570 con 0x7f6e600a96e0 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.141+0000 7f6e65c1d640 1 librados: init done 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.142+0000 7f6e65c1d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.142+0000 7f6e65c1d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.142+0000 7f6e65c1d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:32.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.142+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e60067d70 con 0x7f6e600a96e0 2024-01-23T07:33:32.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.168+0000 7f6e57fff640 1 -- 172.21.15.116:0/2597525743 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6e58007070 con 0x7f6e600a96e0 2024-01-23T07:33:32.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.169+0000 7f6e57fff640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6e4006c860 0x7f6e4006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:32.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.169+0000 7f6e5effd640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6e4006c860 0x7f6e4006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:32.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.169+0000 7f6e5effd640 10 monclient: get_auth_request con 0x7f6e4006c860 auth_method 0 2024-01-23T07:33:32.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.169+0000 7f6e57fff640 10 client.4287.objecter ms_handle_connect 0x7f6e4006c860 2024-01-23T07:33:32.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.169+0000 7f6e5effd640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6e4006c860 0x7f6e4006ed20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e50036000 tx=0x7f6e50008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:32.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.457+0000 7f6e57fff640 1 -- 172.21.15.116:0/2597525743 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6e58058650 con 0x7f6e600a96e0 2024-01-23T07:33:32.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.457+0000 7f6e57fff640 10 client.4287.objecter ms_dispatch 0x7f6e60000b90 osd_map(23..23 src has 1..23) v4 2024-01-23T07:33:32.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.457+0000 7f6e57fff640 3 client.4287.objecter handle_osd_map got epochs [23,23] > 0 2024-01-23T07:33:32.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.457+0000 7f6e57fff640 3 client.4287.objecter handle_osd_map decoding full epoch 23 2024-01-23T07:33:32.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.458+0000 7f6e57fff640 20 client.4287.objecter dump_active .. 0 homeless 2024-01-23T07:33:32.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.458+0000 7f6e57fff640 1 -- 172.21.15.116:0/2597525743 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6e58054990 con 0x7f6e600a96e0 2024-01-23T07:33:32.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.458+0000 7f6e57fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:32.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.458+0000 7f6e57fff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:32.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.726+0000 7f6e65c1d640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-01-23T07:33:32.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.726+0000 7f6e65c1d640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-01-23T07:33:32.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.726+0000 7f6e65c1d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:32.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.726+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6e60140010 con 0x7f6e600a96e0 2024-01-23T07:33:32.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.869+0000 7f6e57fff640 1 -- 172.21.15.116:0/2597525743 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170785 (secure 0 0 0) 0x7f6e58017070 con 0x7f6e600a96e0 2024-01-23T07:33:32.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.869+0000 7f6e57fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-01-23T07:33:32.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.869+0000 7f6e57fff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:32.871 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:33:32.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.871+0000 7f6e65c1d640 10 librados: watch_flush enter 2024-01-23T07:33:32.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.871+0000 7f6e65c1d640 10 librados: watch_flush exit 2024-01-23T07:33:32.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.871+0000 7f6e65c1d640 20 client.4287.objecter shutdown clearing up homeless session... 2024-01-23T07:33:32.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.871+0000 7f6e65c1d640 10 client.4287.objecter successfully canceled tick 2024-01-23T07:33:32.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6e4006c860 msgr2=0x7f6e4006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6e4006c860 0x7f6e4006ed20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e50036000 tx=0x7f6e50008030 comp rx=0 tx=0).stop 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 10 monclient: shutdown 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e600a96e0 msgr2=0x7f6e601dac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e600a96e0 0x7f6e601dac10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800cb10 tx=0x7f6e5800a060 comp rx=0 tx=0).stop 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 shutdown_connections 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6e4006c860 0x7f6e4006ed20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6e60145600 0x7f6e6013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6e6013faa0 0x7f6e600b72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 --2- 172.21.15.116:0/2597525743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6e600a96e0 0x7f6e601dac10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 >> 172.21.15.116:0/2597525743 conn(0x7f6e600b7bb0 msgr2=0x7f6e600b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 shutdown_connections 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 -- 172.21.15.116:0/2597525743 wait complete. 2024-01-23T07:33:32.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:32.872+0000 7f6e65c1d640 1 librados: shutdown 2024-01-23T07:33:32.882 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":2950757295},{"type":"v1","addr":"172.21.15.116:6801","nonce":2950757295}]},"active_addr":"172.21.15.116:6801/2950757295","active_change":"2024-01-23T07:32:34.131511+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4110,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":4063469461}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":1787055483}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":143719045}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.116:0","nonce":1802372477}]}]} 2024-01-23T07:33:32.889 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-23T07:33:32.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-23T07:33:32.889 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T07:33:33.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.009+0000 7fda894a3640 10 monclient: get_monmap_and_config 2024-01-23T07:33:33.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.009+0000 7fda894a3640 10 monclient: build_initial_monmap 2024-01-23T07:33:33.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.009+0000 7fda894a3640 10 monclient: monmap: 2024-01-23T07:33:33.008 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:33.009566+0000 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:33.009566+0000 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:33.009 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.009+0000 7fda894a3640 1 Processor -- start 2024-01-23T07:33:33.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 1 -- start start 2024-01-23T07:33:33.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient: init 2024-01-23T07:33:33.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient: _add_conns ranks=[2,3,0,1,4] 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient(hunting): picked mon.noname-b con 0x7fda840b47b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda840b4090 0x7fda84145c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient(hunting): picked mon.noname-a con 0x7fda840b4090 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fda8413f090 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda840aa930 con 0x7fda8413f090 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda840aa1c0 con 0x7fda840b4090 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda840b4b90 con 0x7fda840b47b0 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:33.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.010+0000 7fda894a3640 10 monclient(hunting): authenticate will time out at 2420.367811s 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.011+0000 7fda7a7fc640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fda840b4090 0x7fda84145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.011+0000 7fda837fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fda8413f090 0x7fda8413f520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48470/0 (socket says 172.21.15.116:48470) 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.011+0000 7fda837fe640 1 -- 172.21.15.116:0/3611470158 learned_addr learned my addr 172.21.15.116:0/3611470158 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.011+0000 7fda7a7fc640 10 monclient(hunting): get_auth_request con 0x7fda840b4090 auth_method 0 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.011+0000 7fda7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.011+0000 7fda7a7fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.011+0000 7fda7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.012+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.012+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:33.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.012+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:33.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.014+0000 7fda82ffd640 1 --2- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_done global_id 4290 payload 274 2024-01-23T07:33:33.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 1 -- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 msgr2=0x7fda841456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:33.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 1 --2- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 1 -- 172.21.15.116:0/3611470158 >> v1:172.21.15.116:6789/0 conn(0x7fda8413f090 legacy=0x7fda8413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 10 monclient: _finish_hunting 0 2024-01-23T07:33:33.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 1 monclient: found mon.noname-a 2024-01-23T07:33:33.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:33.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:33.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.016+0000 7fda7a7fc640 1 -- 172.21.15.116:0/3611470158 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840aaba0 con 0x7fda840b4090 2024-01-23T07:33:33.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.019+0000 7fda7a7fc640 1 --2- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda840b4090 0x7fda84145c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0097d0 tx=0x7fda6c02b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f050d250d579b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:33.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 1 -- 172.21.15.116:0/3611470158 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c031770 con 0x7fda840b4090 2024-01-23T07:33:33.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:33.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: dump: 2024-01-23T07:33:33.032 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.032 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 1 -- 172.21.15.116:0/3611470158 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c0318d0 con 0x7fda840b4090 2024-01-23T07:33:33.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 1 -- 172.21.15.116:0/3611470158 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c031c60 con 0x7fda840b4090 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda894a3640 5 monclient: authenticate success, global_id 4290 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda894a3640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda894a3640 4 set_mon_vals no callback set 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda827fc640 10 monclient: dump: 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.034 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda894a3640 10 monclient: shutdown 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.025+0000 7fda894a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 -- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda840b4090 msgr2=0x7fda84145c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 --2- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda840b4090 0x7fda84145c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0097d0 tx=0x7fda6c02b810 comp rx=0 tx=0).stop 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 -- 172.21.15.116:0/3611470158 shutdown_connections 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 --2- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda840b4090 0x7fda84145c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 --2- 172.21.15.116:0/3611470158 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 -- 172.21.15.116:0/3611470158 >> 172.21.15.116:0/3611470158 conn(0x7fda84066450 msgr2=0x7fda84066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 -- 172.21.15.116:0/3611470158 shutdown_connections 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 1 -- 172.21.15.116:0/3611470158 wait complete. 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 10 monclient: build_initial_monmap 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.026+0000 7fda894a3640 10 monclient: monmap: 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:33.036 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 librados: starting msgr at 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 librados: starting objecter 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 Processor -- start 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 -- start start 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 librados: setting wanted keys 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 librados: calling monclient init 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient: init 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda840b4090 0x7fda84144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): picked mon.noname-b con 0x7fda840b4090 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841da9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): picked mon.noname-c con 0x7fda840b47b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:33.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda8413f090 0x7fda8413bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): picked mon.noname-a con 0x7fda8413f090 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8413c260 con 0x7fda8413f090 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda84141b40 con 0x7fda840b4090 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8413c630 con 0x7fda840b47b0 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.027+0000 7fda894a3640 10 monclient(hunting): authenticate will time out at 2420.385156s 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda7a7fc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841da9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda82ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda840b4090 0x7fda84144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda7a7fc640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841da9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40270/0 (socket says 172.21.15.116:40270) 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda7a7fc640 1 -- 172.21.15.116:0/571388911 learned_addr learned my addr 172.21.15.116:0/571388911 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda7a7fc640 10 monclient(hunting): get_auth_request con 0x7fda840b47b0 auth_method 0 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda7a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda7a7fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda82ffd640 10 monclient(hunting): get_auth_request con 0x7fda840b4090 auth_method 0 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda82ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.028+0000 7fda82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.029+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.029+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.029+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:33.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.029+0000 7fda82ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.029+0000 7fda82ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.029+0000 7fda82ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 10 monclient(hunting): handle_auth_done global_id 14237 payload 824 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 1 -- 172.21.15.116:0/571388911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda840b4090 msgr2=0x7fda84144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda840b4090 0x7fda84144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 1 -- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda8413f090 msgr2=0x7fda8413bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda8413f090 0x7fda8413bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 10 monclient: _finish_hunting 0 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 1 monclient: found mon.noname-c 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda7a7fc640 1 -- 172.21.15.116:0/571388911 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c009400 con 0x7fda840b47b0 2024-01-23T07:33:33.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.032+0000 7fda82ffd640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda840b4090 0x7fda84144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T07:33:33.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.034+0000 7fda7a7fc640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841da9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0097d0 tx=0x7fda6c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:33.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.034+0000 7fda7bfff640 10 client.?.objecter ms_handle_connect 0x7fda840b47b0 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.034+0000 7fda7bfff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 1 -- 172.21.15.116:0/571388911 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c0328d0 con 0x7fda840b47b0 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: dump: 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.043 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: _finish_auth 0 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 5 monclient: authenticate success, global_id 14237 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 1 -- 172.21.15.116:0/571388911 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6c032a50 con 0x7fda840b47b0 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 10 monclient: _renew_subs 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda84140320 con 0x7fda840b47b0 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 1 -- 172.21.15.116:0/571388911 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6c032e00 con 0x7fda840b47b0 2024-01-23T07:33:33.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda7bfff640 10 monclient: dump: 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda81ffb640 4 set_mon_vals no callback set 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 10 client.14237.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:33.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 10 monclient: _renew_subs 2024-01-23T07:33:33.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda84140880 con 0x7fda840b47b0 2024-01-23T07:33:33.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.037+0000 7fda894a3640 1 librados: init done 2024-01-23T07:33:33.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.038+0000 7fda894a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:33.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.038+0000 7fda894a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:33.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.038+0000 7fda894a3640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.038+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda84067d70 con 0x7fda840b47b0 2024-01-23T07:33:33.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.068+0000 7fda7bfff640 1 -- 172.21.15.116:0/571388911 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fda6c04e440 con 0x7fda840b47b0 2024-01-23T07:33:33.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.068+0000 7fda7bfff640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fda6406c860 0x7fda6406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.069+0000 7fda82ffd640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fda6406c860 0x7fda6406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.069+0000 7fda82ffd640 10 monclient: get_auth_request con 0x7fda6406c860 auth_method 0 2024-01-23T07:33:33.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.069+0000 7fda82ffd640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fda6406c860 0x7fda6406ed20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda7400aeb0 tx=0x7fda74008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:33.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.069+0000 7fda7bfff640 10 client.14237.objecter ms_handle_connect 0x7fda6406c860 2024-01-23T07:33:33.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 1 -- 172.21.15.116:0/571388911 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fda6c07afb0 con 0x7fda840b47b0 2024-01-23T07:33:33.302 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 10 client.14237.objecter ms_dispatch 0x7fda84000b90 osd_map(23..23 src has 1..23) v4 2024-01-23T07:33:33.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 3 client.14237.objecter handle_osd_map got epochs [23,23] > 0 2024-01-23T07:33:33.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 3 client.14237.objecter handle_osd_map decoding full epoch 23 2024-01-23T07:33:33.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 20 client.14237.objecter dump_active .. 0 homeless 2024-01-23T07:33:33.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 1 -- 172.21.15.116:0/571388911 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fda6c076bf0 con 0x7fda840b47b0 2024-01-23T07:33:33.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:33.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.303+0000 7fda7bfff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:33.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.481+0000 7fda894a3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:33.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.481+0000 7fda894a3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:33.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.481+0000 7fda894a3640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.481+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda841404b0 con 0x7fda840b47b0 2024-01-23T07:33:33.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.515+0000 7fda7bfff640 1 -- 172.21.15.116:0/571388911 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14687 (secure 0 0 0) 0x7fda841404b0 con 0x7fda840b47b0 2024-01-23T07:33:33.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.515+0000 7fda7bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:33.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.515+0000 7fda7bfff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:33.515 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:33:33.515 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:33:32.926128+0000","last_up_change":"2024-01-23T07:33:23.990340+0000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T07:33:12.781798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-23T07:33:29.906428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6803","nonce":950064745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6805","nonce":950064745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6809","nonce":950064745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6807","nonce":950064745}]},"public_addr":"172.21.15.116:6803/950064745","cluster_addr":"172.21.15.116:6805/950064745","heartbeat_back_addr":"172.21.15.116:6809/950064745","heartbeat_front_addr":"172.21.15.116:6807/950064745","state":["exists","up"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6811","nonce":745967066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6813","nonce":745967066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6817","nonce":745967066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6815","nonce":745967066}]},"public_addr":"172.21.15.116:6811/745967066","cluster_addr":"172.21.15.116:6813/745967066","heartbeat_back_addr":"172.21.15.116:6817/745967066","heartbeat_front_addr":"172.21.15.116:6815/745967066","state":["exists","up"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6827","nonce":2848377313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6829","nonce":2848377313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6833","nonce":2848377313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6831","nonce":2848377313}]},"public_addr":"172.21.15.116:6827/2848377313","cluster_addr":"172.21.15.116:6829/2848377313","heartbeat_back_addr":"172.21.15.116:6833/2848377313","heartbeat_front_addr":"172.21.15.116:6831/2848377313","state":["exists","up"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6819","nonce":1332739445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6821","nonce":1332739445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6825","nonce":1332739445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6823","nonce":1332739445}]},"public_addr":"172.21.15.116:6819/1332739445","cluster_addr":"172.21.15.116:6821/1332739445","heartbeat_back_addr":"172.21.15.116:6825/1332739445","heartbeat_front_addr":"172.21.15.116:6823/1332739445","state":["exists","up"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6807","nonce":3961996474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6811","nonce":3961996474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6815","nonce":3961996474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6813","nonce":3961996474}]},"public_addr":"172.21.15.173:6807/3961996474","cluster_addr":"172.21.15.173:6811/3961996474","heartbeat_back_addr":"172.21.15.173:6815/3961996474","heartbeat_front_addr":"172.21.15.173:6813/3961996474","state":["exists","up"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6801","nonce":1137022367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6803","nonce":1137022367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6809","nonce":1137022367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6805","nonce":1137022367}]},"public_addr":"172.21.15.173:6801/1137022367","cluster_addr":"172.21.15.173:6803/1137022367","heartbeat_back_addr":"172.21.15.173:6809/1137022367","heartbeat_front_addr":"172.21.15.173:6805/1137022367","state":["exists","up"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6817","nonce":548415989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6819","nonce":548415989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6823","nonce":548415989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6821","nonce":548415989}]},"public_addr":"172.21.15.173:6817/548415989","cluster_addr":"172.21.15.173:6819/548415989","heartbeat_back_addr":"172.21.15.173:6823/548415989","heartbeat_front_addr":"172.21.15.173:6821/548415989","state":["exists","up"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6825","nonce":1205985563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6827","nonce":1205985563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6831","nonce":1205985563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6829","nonce":1205985563}]},"public_addr":"172.21.15.173:6825/1205985563","cluster_addr":"172.21.15.173:6827/1205985563","heartbeat_back_addr":"172.21.15.173:6831/1205985563","heartbeat_front_addr":"172.21.15.173:6829/1205985563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.751411+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.227879+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.226283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.349783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.990738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.105254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.482296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.067044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 10 librados: watch_flush enter 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 10 librados: watch_flush exit 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 20 client.14237.objecter shutdown clearing up homeless session... 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 10 client.14237.objecter successfully canceled tick 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fda6406c860 msgr2=0x7fda6406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fda6406c860 0x7fda6406ed20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda7400aeb0 tx=0x7fda74008040 comp rx=0 tx=0).stop 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 10 monclient: shutdown 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 msgr2=0x7fda841da9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841da9d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0097d0 tx=0x7fda6c0046c0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 shutdown_connections 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fda6406c860 0x7fda6406ed20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda8413f090 0x7fda8413bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fda840b47b0 0x7fda841da9d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 --2- 172.21.15.116:0/571388911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda840b4090 0x7fda84144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 >> 172.21.15.116:0/571388911 conn(0x7fda84066450 msgr2=0x7fda840b81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 shutdown_connections 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 -- 172.21.15.116:0/571388911 wait complete. 2024-01-23T07:33:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.517+0000 7fda894a3640 1 librados: shutdown 2024-01-23T07:33:33.527 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-23T07:33:33.528 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.627+0000 7fdb89f49640 10 monclient: get_monmap_and_config 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.627+0000 7fdb89f49640 10 monclient: build_initial_monmap 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.627+0000 7fdb89f49640 10 monclient: monmap: 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:33.627761+0000 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:33.627761+0000 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:33.628 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:33.628 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 1 Processor -- start 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 1 -- start start 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient: init 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdb841458c0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fdb840ac6b0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdb8406c790 0x7fdb8414d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient(hunting): picked mon.noname-a con 0x7fdb8406c790 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8413fda0 con 0x7fdb841458c0 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb8406d550 con 0x7fdb840ac6b0 2024-01-23T07:33:33.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8406fb50 con 0x7fdb8406c790 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.628+0000 7fdb89f49640 10 monclient(hunting): authenticate will time out at 2420.986191s 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.629+0000 7fdb83fff640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fdb8406c790 0x7fdb8414d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.629+0000 7fdb82ffd640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fdb840ac6b0 0x7fdb8406c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42262/0 (socket says 172.21.15.116:42262) 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.629+0000 7fdb82ffd640 1 -- 172.21.15.116:0/3942514489 learned_addr learned my addr 172.21.15.116:0/3942514489 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.630+0000 7fdb83fff640 10 monclient(hunting): get_auth_request con 0x7fdb8406c790 auth_method 0 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.630+0000 7fdb83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.630+0000 7fdb83fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.630+0000 7fdb83fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.630+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.630+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:33.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.630+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.631+0000 7fdb827fc640 1 -- 172.21.15.116:0/3942514489 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2566813150 0 0) 0x7fdb8406d550 con 0x7fdb840ac6b0 2024-01-23T07:33:33.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.631+0000 7fdb827fc640 10 monclient(hunting): _negotiate 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.631+0000 7fdb827fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.631+0000 7fdb827fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.631+0000 7fdb827fc640 10 monclient(hunting): my global_id is 4282 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.631+0000 7fdb827fc640 1 -- 172.21.15.116:0/3942514489 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6c003520 con 0x7fdb840ac6b0 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 10 monclient(hunting): handle_auth_done global_id 4296 payload 274 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 1 -- 172.21.15.116:0/3942514489 >> v1:172.21.15.173:6789/0 conn(0x7fdb840ac6b0 legacy=0x7fdb8406c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 1 -- 172.21.15.116:0/3942514489 >> v1:172.21.15.116:6789/0 conn(0x7fdb841458c0 legacy=0x7fdb840718c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 1 monclient: found mon.noname-a 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:33.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.632+0000 7fdb83fff640 1 -- 172.21.15.116:0/3942514489 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb84071fd0 con 0x7fdb8406c790 2024-01-23T07:33:33.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.637+0000 7fdb83fff640 1 --2- 172.21.15.116:0/3942514489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8406c790 0x7fdb8414d9b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009d90 tx=0x7fdb7c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b57bd2bcd480e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 1 -- 172.21.15.116:0/3942514489 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c02cc60 con 0x7fdb8406c790 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: dump: 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.642 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 1 -- 172.21.15.116:0/3942514489 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c02cdc0 con 0x7fdb8406c790 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 1 -- 172.21.15.116:0/3942514489 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c034660 con 0x7fdb8406c790 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb89f49640 5 monclient: authenticate success, global_id 4296 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb89f49640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb89f49640 4 set_mon_vals no callback set 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.642+0000 7fdb827fc640 10 monclient: dump: 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.644 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 10 monclient: shutdown 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 1 -- 172.21.15.116:0/3942514489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8406c790 msgr2=0x7fdb8414d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 1 --2- 172.21.15.116:0/3942514489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8406c790 0x7fdb8414d9b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c009d90 tx=0x7fdb7c02beb0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 1 -- 172.21.15.116:0/3942514489 shutdown_connections 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 1 --2- 172.21.15.116:0/3942514489 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb8406c790 0x7fdb8414d9b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 1 -- 172.21.15.116:0/3942514489 >> 172.21.15.116:0/3942514489 conn(0x7fdb84066d90 msgr2=0x7fdb840b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 1 -- 172.21.15.116:0/3942514489 shutdown_connections 2024-01-23T07:33:33.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.643+0000 7fdb89f49640 1 -- 172.21.15.116:0/3942514489 wait complete. 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.644+0000 7fdb89f49640 10 monclient: build_initial_monmap 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.644+0000 7fdb89f49640 10 monclient: monmap: 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.644+0000 7fdb89f49640 1 librados: starting msgr at 2024-01-23T07:33:33.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.644+0000 7fdb89f49640 1 librados: starting objecter 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.644+0000 7fdb89f49640 1 Processor -- start 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 -- start start 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 librados: setting wanted keys 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 librados: calling monclient init 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient: init 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb840ac6b0 0x7fdb840abfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): picked mon.noname-a con 0x7fdb840ac6b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb841458c0 0x7fdb840a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): picked mon.noname-c con 0x7fdb841458c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb840aa050 0x7fdb841da830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): picked mon.noname-b con 0x7fdb840aa050 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb840ab390 con 0x7fdb840ac6b0 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb840ab570 con 0x7fdb840aa050 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb840ab850 con 0x7fdb841458c0 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.645+0000 7fdb89f49640 10 monclient(hunting): authenticate will time out at 2421.002818s 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb837fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb840ac6b0 0x7fdb840abfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb841458c0 0x7fdb840a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb841458c0 0x7fdb840a9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40274/0 (socket says 172.21.15.116:40274) 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 1 -- 172.21.15.116:0/1448669298 learned_addr learned my addr 172.21.15.116:0/1448669298 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 10 monclient(hunting): get_auth_request con 0x7fdb841458c0 auth_method 0 2024-01-23T07:33:33.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb837fe640 10 monclient(hunting): get_auth_request con 0x7fdb840ac6b0 auth_method 0 2024-01-23T07:33:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb837fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb837fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb837fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb83fff640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb840aa050 0x7fdb841da830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb83fff640 10 monclient(hunting): get_auth_request con 0x7fdb840aa050 auth_method 0 2024-01-23T07:33:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb83fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb83fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb83fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:33.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.646+0000 7fdb82ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.647+0000 7fdb82ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.647+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.647+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.647+0000 7fdb837fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.647+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:33.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.647+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:33.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.647+0000 7fdb83fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 10 monclient(hunting): handle_auth_done global_id 14240 payload 824 2024-01-23T07:33:33.661 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 1 -- 172.21.15.116:0/1448669298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb840aa050 msgr2=0x7fdb841da830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb840aa050 0x7fdb841da830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 1 -- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb840ac6b0 msgr2=0x7fdb840abfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb840ac6b0 0x7fdb840abfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 1 monclient: found mon.noname-c 2024-01-23T07:33:33.662 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.649+0000 7fdb82ffd640 1 -- 172.21.15.116:0/1448669298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c009a70 con 0x7fdb841458c0 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.652+0000 7fdb82ffd640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb841458c0 0x7fdb840a9b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c500 tx=0x7fdb7400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.652+0000 7fdb6bfff640 10 client.?.objecter ms_handle_connect 0x7fdb841458c0 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.652+0000 7fdb6bfff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 1 -- 172.21.15.116:0/1448669298 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74005ce0 con 0x7fdb841458c0 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: dump: 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.663 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.664 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: _finish_auth 0 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 1 -- 172.21.15.116:0/1448669298 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb74005e40 con 0x7fdb841458c0 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 5 monclient: authenticate success, global_id 14240 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 10 monclient: _renew_subs 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb840a95f0 con 0x7fdb841458c0 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:33.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 1 -- 172.21.15.116:0/1448669298 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74007330 con 0x7fdb841458c0 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb6bfff640 10 monclient: dump: 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:33.666 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb817fa640 4 set_mon_vals no callback set 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 10 client.14240.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 10 monclient: _renew_subs 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8413adc0 con 0x7fdb841458c0 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.655+0000 7fdb89f49640 1 librados: init done 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.656+0000 7fdb89f49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.656+0000 7fdb89f49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.656+0000 7fdb89f49640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:33.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.656+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb840a97e0 con 0x7fdb841458c0 2024-01-23T07:33:33.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.900+0000 7fdb6bfff640 1 -- 172.21.15.116:0/1448669298 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdb74007490 con 0x7fdb841458c0 2024-01-23T07:33:33.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.900+0000 7fdb6bfff640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb7006c8e0 0x7fdb7006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:33.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.900+0000 7fdb837fe640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb7006c8e0 0x7fdb7006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:33.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.900+0000 7fdb837fe640 10 monclient: get_auth_request con 0x7fdb7006c8e0 auth_method 0 2024-01-23T07:33:33.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.901+0000 7fdb6bfff640 10 client.14240.objecter ms_handle_connect 0x7fdb7006c8e0 2024-01-23T07:33:33.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.901+0000 7fdb837fe640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb7006c8e0 0x7fdb7006eda0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb780016e0 tx=0x7fdb78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 1 -- 172.21.15.116:0/1448669298 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdb74007740 con 0x7fdb841458c0 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 10 client.14240.objecter ms_dispatch 0x7fdb84000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 3 client.14240.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 3 client.14240.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 20 client.14240.objecter dump_active .. 0 homeless 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 1 -- 172.21.15.116:0/1448669298 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdb740540f0 con 0x7fdb841458c0 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:33.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:33.914+0000 7fdb6bfff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:34.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.088+0000 7fdb89f49640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:34.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.088+0000 7fdb89f49640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:34.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.088+0000 7fdb89f49640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.088+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb8404ea10 con 0x7fdb841458c0 2024-01-23T07:33:34.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.130+0000 7fdb6bfff640 1 -- 172.21.15.116:0/1448669298 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14687 (secure 0 0 0) 0x7fdb74017090 con 0x7fdb841458c0 2024-01-23T07:33:34.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.130+0000 7fdb6bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T07:33:34.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.130+0000 7fdb6bfff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:34.131 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:33:34.131 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":24,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T07:33:32.926128+0000","last_up_change":"2024-01-23T07:33:23.990340+0000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T07:33:12.781798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-23T07:33:29.906428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6803","nonce":950064745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6805","nonce":950064745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6809","nonce":950064745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6807","nonce":950064745}]},"public_addr":"172.21.15.116:6803/950064745","cluster_addr":"172.21.15.116:6805/950064745","heartbeat_back_addr":"172.21.15.116:6809/950064745","heartbeat_front_addr":"172.21.15.116:6807/950064745","state":["exists","up"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6811","nonce":745967066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6813","nonce":745967066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6817","nonce":745967066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6815","nonce":745967066}]},"public_addr":"172.21.15.116:6811/745967066","cluster_addr":"172.21.15.116:6813/745967066","heartbeat_back_addr":"172.21.15.116:6817/745967066","heartbeat_front_addr":"172.21.15.116:6815/745967066","state":["exists","up"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6827","nonce":2848377313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6829","nonce":2848377313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6833","nonce":2848377313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6831","nonce":2848377313}]},"public_addr":"172.21.15.116:6827/2848377313","cluster_addr":"172.21.15.116:6829/2848377313","heartbeat_back_addr":"172.21.15.116:6833/2848377313","heartbeat_front_addr":"172.21.15.116:6831/2848377313","state":["exists","up"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6819","nonce":1332739445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6821","nonce":1332739445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6825","nonce":1332739445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6823","nonce":1332739445}]},"public_addr":"172.21.15.116:6819/1332739445","cluster_addr":"172.21.15.116:6821/1332739445","heartbeat_back_addr":"172.21.15.116:6825/1332739445","heartbeat_front_addr":"172.21.15.116:6823/1332739445","state":["exists","up"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6807","nonce":3961996474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6811","nonce":3961996474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6815","nonce":3961996474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6813","nonce":3961996474}]},"public_addr":"172.21.15.173:6807/3961996474","cluster_addr":"172.21.15.173:6811/3961996474","heartbeat_back_addr":"172.21.15.173:6815/3961996474","heartbeat_front_addr":"172.21.15.173:6813/3961996474","state":["exists","up"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6801","nonce":1137022367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6803","nonce":1137022367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6809","nonce":1137022367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6805","nonce":1137022367}]},"public_addr":"172.21.15.173:6801/1137022367","cluster_addr":"172.21.15.173:6803/1137022367","heartbeat_back_addr":"172.21.15.173:6809/1137022367","heartbeat_front_addr":"172.21.15.173:6805/1137022367","state":["exists","up"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6817","nonce":548415989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6819","nonce":548415989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6823","nonce":548415989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6821","nonce":548415989}]},"public_addr":"172.21.15.173:6817/548415989","cluster_addr":"172.21.15.173:6819/548415989","heartbeat_back_addr":"172.21.15.173:6823/548415989","heartbeat_front_addr":"172.21.15.173:6821/548415989","state":["exists","up"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6825","nonce":1205985563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6827","nonce":1205985563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6831","nonce":1205985563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6829","nonce":1205985563}]},"public_addr":"172.21.15.173:6825/1205985563","cluster_addr":"172.21.15.173:6827/1205985563","heartbeat_back_addr":"172.21.15.173:6831/1205985563","heartbeat_front_addr":"172.21.15.173:6829/1205985563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.751411+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.227879+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.226283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.349783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.990738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.105254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.482296+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.067044+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 10 librados: watch_flush enter 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 10 librados: watch_flush exit 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 20 client.14240.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 10 client.14240.objecter successfully canceled tick 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb7006c8e0 msgr2=0x7fdb7006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb7006c8e0 0x7fdb7006eda0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdb780016e0 tx=0x7fdb78009040 comp rx=0 tx=0).stop 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 10 monclient: shutdown 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb841458c0 msgr2=0x7fdb840a9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb841458c0 0x7fdb840a9b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c500 tx=0x7fdb7400c9c0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 shutdown_connections 2024-01-23T07:33:34.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb7006c8e0 0x7fdb7006eda0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb840aa050 0x7fdb841da830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb841458c0 0x7fdb840a9b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 --2- 172.21.15.116:0/1448669298 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb840ac6b0 0x7fdb840abfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 >> 172.21.15.116:0/1448669298 conn(0x7fdb84066d90 msgr2=0x7fdb8413df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 shutdown_connections 2024-01-23T07:33:34.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 -- 172.21.15.116:0/1448669298 wait complete. 2024-01-23T07:33:34.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.132+0000 7fdb89f49640 1 librados: shutdown 2024-01-23T07:33:34.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-23T07:33:34.144 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-23T07:33:34.144 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-23T07:33:34.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-23T07:33:34.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-23T07:33:34.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-23T07:33:34.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-23T07:33:34.146 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-23T07:33:34.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.323+0000 7f46dfc6e640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.323+0000 7f46dfc6e640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.323+0000 7f46dfc6e640 10 monclient: monmap: 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.324414+0000 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.324414+0000 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.325 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.323+0000 7ff5b6f64640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.323+0000 7ff5b6f64640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.323+0000 7ff5b6f64640 10 monclient: monmap: 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.324815+0000 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.324815+0000 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.326 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.324+0000 7ff5b6f64640 1 Processor -- start 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.324+0000 7f46dfc6e640 1 Processor -- start 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.324+0000 7f46dfc6e640 1 -- start start 2024-01-23T07:33:34.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.324+0000 7f46dfc6e640 10 monclient: init 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.324+0000 7ff5b6f64640 1 -- start start 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.324+0000 7ff5b6f64640 10 monclient: init 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff5b00ac810 0x7ff5b00acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient(hunting): picked mon.noname-c con 0x7ff5b00ac810 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7ff5b013b600 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff5b013ba40 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b01415e0 con 0x7ff5b013ba40 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b0142540 con 0x7ff5b013b600 2024-01-23T07:33:34.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00ad500 con 0x7ff5b00ac810 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7fccb27c9640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7fccb27c9640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7fccb27c9640 10 monclient: monmap: 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.326971+0000 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.326971+0000 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.329 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.330 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.330 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.330 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.330 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.330 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.330 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7ff5b6f64640 10 monclient(hunting): authenticate will time out at 2421.684003s 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient: _add_conns ranks=[2,0,3,4,1] 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d80abb10 0x7f46d80abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient(hunting): picked mon.noname-b con 0x7f46d80abb10 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f46d80720f0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f46d81409a0 0x7f46d813d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient(hunting): picked mon.noname-a con 0x7f46d81409a0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d80adb10 con 0x7f46d80720f0 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d8140e50 con 0x7f46d81409a0 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80add80 con 0x7f46d80abb10 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.325+0000 7f46dfc6e640 10 monclient(hunting): authenticate will time out at 2421.684153s 2024-01-23T07:33:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.326+0000 7ff5b4d00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff5b00ac810 0x7ff5b00acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.326+0000 7fca8b8f8640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.326+0000 7fca8b8f8640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.326+0000 7fca8b8f8640 10 monclient: monmap: 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.327533+0000 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.327533+0000 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.333 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7f46dda0a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d80abb10 0x7f46d80abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7f46dda0a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d80abb10 0x7f46d80abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40280/0 (socket says 172.21.15.116:40280) 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7f46dda0a640 1 -- 172.21.15.116:0/3138642069 learned_addr learned my addr 172.21.15.116:0/3138642069 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7f46dda0a640 10 monclient(hunting): get_auth_request con 0x7f46d80abb10 auth_method 0 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7f46dda0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7f46dda0a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7f46dda0a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7ff5b4d00640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ff5b00ac810 0x7ff5b00acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37612/0 (socket says 172.21.15.116:37612) 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7ff5b4d00640 1 -- 172.21.15.116:0/2619632841 learned_addr learned my addr 172.21.15.116:0/2619632841 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7ff5b4d00640 10 monclient(hunting): get_auth_request con 0x7ff5b00ac810 auth_method 0 2024-01-23T07:33:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7ff5b4d00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7ff5b4d00640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.327+0000 7ff5b4d00640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.328+0000 7f46dda0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.328+0000 7f46dda0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.328+0000 7f46dda0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.328+0000 7ff5b4d00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.328+0000 7ff5b4d00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.328+0000 7ff5b4d00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.329+0000 7fca8b8f8640 1 Processor -- start 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.329+0000 7fca8b8f8640 1 -- start start 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.329+0000 7fca8b8f8640 10 monclient: init 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient: _add_conns ranks=[4,1,3,2,0] 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca840a9900 0x7fca840a9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient(hunting): picked mon.noname-c con 0x7fca840a9900 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fca840aab80 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fca840ac250 0x7fca84143830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient(hunting): picked mon.noname-a con 0x7fca840ac250 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca840abbc0 con 0x7fca840aab80 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca840abe30 con 0x7fca840ac250 2024-01-23T07:33:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca841472c0 con 0x7fca840a9900 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.330+0000 7fca8b8f8640 10 monclient(hunting): authenticate will time out at 2421.688915s 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 10 monclient(hunting): handle_auth_done global_id 14243 payload 274 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 1 -- 172.21.15.116:0/3138642069 >> v2:172.21.15.116:3300/0 conn(0x7f46d81409a0 msgr2=0x7f46d813d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 1 --2- 172.21.15.116:0/3138642069 >> v2:172.21.15.116:3300/0 conn(0x7f46d81409a0 0x7f46d813d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 1 -- 172.21.15.116:0/3138642069 >> v1:172.21.15.116:6789/0 conn(0x7f46d80720f0 legacy=0x7f46d80ae6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 1 monclient: found mon.noname-b 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.339 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.331+0000 7f46dda0a640 1 -- 172.21.15.116:0/3138642069 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8140430 con 0x7f46d80abb10 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 10 monclient(hunting): handle_auth_done global_id 4288 payload 274 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 1 -- 172.21.15.116:0/2619632841 >> v1:172.21.15.173:6789/0 conn(0x7ff5b013b600 legacy=0x7ff5b013e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 1 -- 172.21.15.116:0/2619632841 >> v1:172.21.15.116:6789/0 conn(0x7ff5b013ba40 legacy=0x7ff5b0148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.340 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7ff5b4d00640 1 -- 172.21.15.116:0/2619632841 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b00adec0 con 0x7ff5b00ac810 2024-01-23T07:33:34.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7fc61319d640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fca88e93640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fca840aab80 0x7fca84146bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42282/0 (socket says 172.21.15.116:42282) 2024-01-23T07:33:34.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fca89694640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fca840a9900 0x7fca840a9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fca88e93640 1 -- 172.21.15.116:0/2678868261 learned_addr learned my addr 172.21.15.116:0/2678868261 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7fc61319d640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.333+0000 7fc61319d640 10 monclient: monmap: 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.334360+0000 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.334360+0000 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fca89694640 10 monclient(hunting): get_auth_request con 0x7fca840a9900 auth_method 0 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fca89694640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fca89694640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fca89694640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.334+0000 7fc61319d640 1 Processor -- start 2024-01-23T07:33:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7f46dda0a640 1 --2- 172.21.15.116:0/3138642069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d80abb10 0x7f46d80abef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009870 tx=0x7f46c802b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23def2bef4aa904e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fca89694640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fca89694640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fca89694640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fc61319d640 1 -- start start 2024-01-23T07:33:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fc61319d640 10 monclient: init 2024-01-23T07:33:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fccb27c9640 1 Processor -- start 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc60c0ac810 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc60c0b0e40 0x7fc60c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient(hunting): picked mon.noname-c con 0x7fc60c0b0e40 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc60c13e950 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c1415e0 con 0x7fc60c13e950 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c13bd10 con 0x7fc60c0ac810 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c0ad500 con 0x7fc60c0b0e40 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fc61319d640 10 monclient(hunting): authenticate will time out at 2421.694426s 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fccb27c9640 1 -- start start 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.335+0000 7fccb27c9640 10 monclient: init 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fccb27c9640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fccb27c9640 10 monclient: _add_conns ranks=[1,0,4,3,2] 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fccb27c9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fccac0b0540 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fccb27c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fccac072550 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.336+0000 7fccb27c9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fccac13c5b0 0x7fccac14a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.337+0000 7fccb27c9640 10 monclient(hunting): picked mon.noname-c con 0x7fccac13c5b0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.337+0000 7fccb27c9640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac0720c0 con 0x7fccac072550 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.337+0000 7fccb27c9640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccac072990 con 0x7fccac0b0540 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.337+0000 7fccb27c9640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.337+0000 7fccb27c9640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccac06fe20 con 0x7fccac13c5b0 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.337+0000 7fccb27c9640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.337+0000 7fccb27c9640 10 monclient(hunting): authenticate will time out at 2421.695349s 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 10 monclient(hunting): handle_auth_done global_id 4294 payload 274 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 1 -- 172.21.15.116:0/2678868261 >> v2:172.21.15.116:3300/0 conn(0x7fca840ac250 msgr2=0x7fca84143830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 1 --2- 172.21.15.116:0/2678868261 >> v2:172.21.15.116:3300/0 conn(0x7fca840ac250 0x7fca84143830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 1 -- 172.21.15.116:0/2678868261 >> v1:172.21.15.173:6789/0 conn(0x7fca840aab80 legacy=0x7fca84146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.338+0000 7fca89694640 1 -- 172.21.15.116:0/2678868261 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84147400 con 0x7fca840a9900 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 1 -- 172.21.15.116:0/3138642069 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8030860 con 0x7f46d80abb10 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: dump: 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 1 -- 172.21.15.116:0/3138642069 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c80309c0 con 0x7f46d80abb10 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dfc6e640 5 monclient: authenticate success, global_id 14243 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dfc6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dfc6e640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dfc6e640 4 set_mon_vals no callback set 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 1 -- 172.21.15.116:0/3138642069 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8030d30 con 0x7f46d80abb10 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7f46dca08640 10 monclient: dump: 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.352 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.341+0000 7fc60bfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc60c0b0e40 0x7fc60c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7fc60bfff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fc60c0b0e40 0x7fc60c13e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37640/0 (socket says 172.21.15.116:37640) 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7fc60bfff640 1 -- 172.21.15.116:0/1067097767 learned_addr learned my addr 172.21.15.116:0/1067097767 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7fc60bfff640 10 monclient(hunting): get_auth_request con 0x7fc60c0b0e40 auth_method 0 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7fc60bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7fc60bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7fc60bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 10 monclient: shutdown 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 -- 172.21.15.116:0/3138642069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d80abb10 msgr2=0x7f46d80abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 --2- 172.21.15.116:0/3138642069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d80abb10 0x7f46d80abef0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009870 tx=0x7f46c802b9a0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f06d9df7640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f06d9df7640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f06d9df7640 10 monclient: monmap: 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.343280+0000 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.343280+0000 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 -- 172.21.15.116:0/3138642069 shutdown_connections 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 --2- 172.21.15.116:0/3138642069 >> v2:172.21.15.116:3300/0 conn(0x7f46d81409a0 0x7f46d813d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 --2- 172.21.15.116:0/3138642069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d80abb10 0x7f46d80abef0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 -- 172.21.15.116:0/3138642069 >> 172.21.15.116:0/3138642069 conn(0x7f46d80b0320 msgr2=0x7f46d80b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 -- 172.21.15.116:0/3138642069 shutdown_connections 2024-01-23T07:33:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 1 Processor -- start 2024-01-23T07:33:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 1 -- start start 2024-01-23T07:33:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.342+0000 7f46dfc6e640 1 -- 172.21.15.116:0/3138642069 wait complete. 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient: init 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f46dfc6e640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f46dfc6e640 10 monclient: monmap: 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient: _add_conns ranks=[4,2,1,3,0] 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f06d406c460 0x7f06d40b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient(hunting): picked mon.noname-c con 0x7f06d406c460 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d40b37b0 0x7f06d40aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient(hunting): picked mon.noname-b con 0x7f06d40b37b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f06d413f1b0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40b1390 con 0x7f06d413f1b0 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d406c840 con 0x7f06d406c460 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40ae920 con 0x7f06d40b37b0 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f06d9df7640 10 monclient(hunting): authenticate will time out at 2421.702162s 2024-01-23T07:33:34.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f46dfc6e640 1 librados: starting msgr at 2024-01-23T07:33:34.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.343+0000 7f46dfc6e640 1 librados: starting objecter 2024-01-23T07:33:34.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f46dfc6e640 1 Processor -- start 2024-01-23T07:33:34.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f46dfc6e640 1 -- start start 2024-01-23T07:33:34.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f46dfc6e640 1 librados: setting wanted keys 2024-01-23T07:33:34.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f46dfc6e640 1 librados: calling monclient init 2024-01-23T07:33:34.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f46dfc6e640 10 monclient: init 2024-01-23T07:33:34.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f06d3fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d40b37b0 0x7f06d40aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f06d3fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d40b37b0 0x7f06d40aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40286/0 (socket says 172.21.15.116:40286) 2024-01-23T07:33:34.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.344+0000 7f06d3fff640 1 -- 172.21.15.116:0/4019340496 learned_addr learned my addr 172.21.15.116:0/4019340496 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f06d3fff640 10 monclient(hunting): get_auth_request con 0x7f06d40b37b0 auth_method 0 2024-01-23T07:33:34.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f06d3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f06d3fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f06d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:34.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46d80abb10 0x7f46d81390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): picked mon.noname-b con 0x7f46d80abb10 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.362 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46d81409a0 0x7f46d81dacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): picked mon.noname-a con 0x7f46d81409a0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d81db210 0x7f46d812f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): picked mon.noname-c con 0x7f46d81db210 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d813b6a0 con 0x7f46d81409a0 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d81310a0 con 0x7f46d80abb10 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d813afa0 con 0x7f46d81db210 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f46dfc6e640 10 monclient(hunting): authenticate will time out at 2421.703616s 2024-01-23T07:33:34.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f06d3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f06d3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7f06d3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7fbf022c5640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7fbf022c5640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.345+0000 7fbf022c5640 10 monclient: monmap: 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.346788+0000 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.346788+0000 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.365 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.366 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.366 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.346+0000 7fccab7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fccac072550 0x7fccac13bea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48500/0 (socket says 172.21.15.116:48500) 2024-01-23T07:33:34.366 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.346+0000 7fccab7fe640 1 -- 172.21.15.116:0/1861142637 learned_addr learned my addr 172.21.15.116:0/1861142637 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.346+0000 7fbf022c5640 1 Processor -- start 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.346+0000 7fbf022c5640 1 -- start start 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.346+0000 7fbf022c5640 10 monclient: init 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient: _add_conns ranks=[0,4,3,2,1] 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbefc149be0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbefc149fc0 0x7fbefc06dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient(hunting): picked mon.noname-c con 0x7fbefc149fc0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbefc0b18b0 0x7fbefc06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7ff5b4d00640 1 --2- 172.21.15.116:0/2619632841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b00ac810 0x7ff5b00acbf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00091e0 tx=0x7ff5a002cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5533e10aad290c2d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient(hunting): picked mon.noname-a con 0x7fbefc0b18b0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:34.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc14a470 con 0x7fbefc149be0 2024-01-23T07:33:34.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc071ed0 con 0x7fbefc0b18b0 2024-01-23T07:33:34.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbefc072010 con 0x7fbefc149fc0 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fbf022c5640 10 monclient(hunting): authenticate will time out at 2421.705586s 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 10 monclient(hunting): handle_auth_done global_id 14246 payload 274 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 1 -- 172.21.15.116:0/4019340496 >> v2:172.21.15.173:3300/0 conn(0x7f06d406c460 msgr2=0x7f06d40b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 1 --2- 172.21.15.116:0/4019340496 >> v2:172.21.15.173:3300/0 conn(0x7f06d406c460 0x7f06d40b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 1 -- 172.21.15.116:0/4019340496 >> v1:172.21.15.173:6789/0 conn(0x7f06d413f1b0 legacy=0x7f06d413f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 1 monclient: found mon.noname-b 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7f06d3fff640 1 -- 172.21.15.116:0/4019340496 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40af480 con 0x7f06d40b37b0 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fc60bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fc60bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.347+0000 7fc60bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 10 monclient(hunting): handle_auth_done global_id 4300 payload 274 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 1 -- 172.21.15.116:0/1067097767 >> v1:172.21.15.173:6789/0 conn(0x7fc60c0ac810 legacy=0x7fc60c0acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 1 -- 172.21.15.116:0/1067097767 >> v1:172.21.15.116:6789/0 conn(0x7fc60c13e950 legacy=0x7fc60c13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.349+0000 7fc60bfff640 1 -- 172.21.15.116:0/1067097767 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c142540 con 0x7fc60c0b0e40 2024-01-23T07:33:34.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.350+0000 7f06d3fff640 1 --2- 172.21.15.116:0/4019340496 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d40b37b0 0x7f06d40aef40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009870 tx=0x7f06c002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1d3de7572178420 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.371 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.353+0000 7fbf00862640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbefc0b18b0 0x7fbefc06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.353+0000 7fc60bfff640 1 --2- 172.21.15.116:0/1067097767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0b0e40 0x7fc60c13e410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc604009e50 tx=0x7fc60402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71bb2ec9290e1e01 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7f46dd209640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46d81409a0 0x7f46d81dacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.372 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7f46de20b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d81db210 0x7f46d812f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fbf00862640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbefc0b18b0 0x7fbefc06e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54480/0 (socket says 172.21.15.116:54480) 2024-01-23T07:33:34.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fbf00862640 1 -- 172.21.15.116:0/198951356 learned_addr learned my addr 172.21.15.116:0/198951356 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fbf00862640 10 monclient(hunting): get_auth_request con 0x7fbefc0b18b0 auth_method 0 2024-01-23T07:33:34.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fbf00862640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fbf00862640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fbf00862640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376542972 0 0) 0x7fccac0720c0 con 0x7fccac072550 2024-01-23T07:33:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fccaaffd640 10 monclient(hunting): _negotiate 2024-01-23T07:33:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fccaaffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fccaaffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fccaaffd640 10 monclient(hunting): my global_id is 4311 2024-01-23T07:33:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc94003520 con 0x7fccac072550 2024-01-23T07:33:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.354+0000 7f46dda0a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46d80abb10 0x7f46d81390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 1 -- 172.21.15.116:0/4019340496 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c00317c0 con 0x7f06d40b37b0 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: dump: 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 1 -- 172.21.15.116:0/4019340496 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0031920 con 0x7f06d40b37b0 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 1 -- 172.21.15.116:0/4019340496 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0031cb0 con 0x7f06d40b37b0 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d9df7640 5 monclient: authenticate success, global_id 14246 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d9df7640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d9df7640 4 set_mon_vals no callback set 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d37fe640 10 monclient: dump: 2024-01-23T07:33:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7fbf00862640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7fbf00862640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7fbf00862640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d81db210 0x7f46d812f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40300/0 (socket says 172.21.15.116:40300) 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 1 -- 172.21.15.116:0/2867398437 learned_addr learned my addr 172.21.15.116:0/2867398437 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 10 monclient(hunting): get_auth_request con 0x7f46d81db210 auth_method 0 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.378 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f46de20b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d9df7640 10 monclient: shutdown 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d9df7640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d9df7640 1 -- 172.21.15.116:0/4019340496 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d40b37b0 msgr2=0x7f06d40aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.355+0000 7f06d9df7640 1 --2- 172.21.15.116:0/4019340496 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d40b37b0 0x7f06d40aef40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009870 tx=0x7f06c002b860 comp rx=0 tx=0).stop 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f06d9df7640 1 -- 172.21.15.116:0/4019340496 shutdown_connections 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f06d9df7640 1 --2- 172.21.15.116:0/4019340496 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d40b37b0 0x7f06d40aef40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f06d9df7640 1 --2- 172.21.15.116:0/4019340496 >> v2:172.21.15.173:3300/0 conn(0x7f06d406c460 0x7f06d40b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f06d9df7640 1 -- 172.21.15.116:0/4019340496 >> 172.21.15.116:0/4019340496 conn(0x7f06d40b7a40 msgr2=0x7f06d40b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f06d9df7640 1 -- 172.21.15.116:0/4019340496 shutdown_connections 2024-01-23T07:33:34.380 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f06d9df7640 1 -- 172.21.15.116:0/4019340496 wait complete. 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f46dda0a640 10 monclient(hunting): get_auth_request con 0x7f46d80abb10 auth_method 0 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f46dda0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f46dda0a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.356+0000 7f46dda0a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 10 monclient: monmap: 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.381 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.382 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 10 monclient(hunting): handle_auth_done global_id 4314 payload 274 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 1 -- 172.21.15.116:0/198951356 >> v2:172.21.15.173:3300/0 conn(0x7fbefc149fc0 msgr2=0x7fbefc06dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 1 --2- 172.21.15.116:0/198951356 >> v2:172.21.15.173:3300/0 conn(0x7fbefc149fc0 0x7fbefc06dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 1 -- 172.21.15.116:0/198951356 >> v1:172.21.15.116:6789/0 conn(0x7fbefc149be0 legacy=0x7fbefc0717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 1 monclient: found mon.noname-a 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.383 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7fbf00862640 1 -- 172.21.15.116:0/198951356 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc072390 con 0x7fbefc0b18b0 2024-01-23T07:33:34.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 1 librados: starting msgr at 2024-01-23T07:33:34.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 1 librados: starting objecter 2024-01-23T07:33:34.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 1 Processor -- start 2024-01-23T07:33:34.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 1 -- start start 2024-01-23T07:33:34.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 1 librados: setting wanted keys 2024-01-23T07:33:34.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 1 librados: calling monclient init 2024-01-23T07:33:34.384 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.357+0000 7f06d9df7640 10 monclient: init 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d406c460 0x7f06d4142520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): picked mon.noname-b con 0x7f06d406c460 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d40b37b0 0x7f06d4144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): picked mon.noname-a con 0x7f06d40b37b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d413f1b0 0x7f06d41daf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): picked mon.noname-c con 0x7f06d413f1b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4145150 con 0x7f06d40b37b0 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41daa20 con 0x7f06d406c460 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4145360 con 0x7f06d413f1b0 2024-01-23T07:33:34.385 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f06d9df7640 10 monclient(hunting): authenticate will time out at 2421.717174s 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f46dda0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f46dda0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f46dda0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f46dd209640 10 monclient(hunting): get_auth_request con 0x7f46d81409a0 auth_method 0 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f46dd209640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f46dd209640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.358+0000 7f46dd209640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.386 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 10 monclient(hunting): handle_auth_done global_id 14249 payload 824 2024-01-23T07:33:34.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7fccb0d66640 1 --2- 172.21.15.116:0/1861142637 >> v2:172.21.15.173:3300/0 conn(0x7fccac13c5b0 0x7fccac14a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 1 -- 172.21.15.116:0/2867398437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46d80abb10 msgr2=0x7f46d81390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46d80abb10 0x7f46d81390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 1 -- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46d81409a0 msgr2=0x7f46d81dacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.387 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46d81409a0 0x7f46d81dacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.360+0000 7f46de20b640 1 -- 172.21.15.116:0/2867398437 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c80094d0 con 0x7f46d81db210 2024-01-23T07:33:34.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.363+0000 7f06d95f6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d413f1b0 0x7f06d41daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.388 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.363+0000 7fbf00862640 1 --2- 172.21.15.116:0/198951356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc06e0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0b56e0 tx=0x7fbef402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf24dd1d1dfc2ae server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.363+0000 7f06d95f6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d413f1b0 0x7f06d41daf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40306/0 (socket says 172.21.15.116:40306) 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.363+0000 7f06d95f6640 1 -- 172.21.15.116:0/2582107303 learned_addr learned my addr 172.21.15.116:0/2582107303 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.363+0000 7f06d95f6640 10 monclient(hunting): get_auth_request con 0x7f06d413f1b0 auth_method 0 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f06d95f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f06d95f6640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f06d95f6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f06d95f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.389 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f06d95f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f72dc36b640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f72dc36b640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f72dc36b640 10 monclient: monmap: 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.365734+0000 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.365734+0000 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.390 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.391 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.391 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.391 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 453329151 0 0) 0x7fcc94003520 con 0x7fccac072550 2024-01-23T07:33:34.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 >> v2:172.21.15.173:3300/0 conn(0x7fccac13c5b0 msgr2=0x7fccac14a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.391 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 --2- 172.21.15.116:0/1861142637 >> v2:172.21.15.173:3300/0 conn(0x7fccac13c5b0 0x7fccac14a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 >> v1:172.21.15.173:6789/0 conn(0x7fccac0b0540 legacy=0x7fccac06f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 monclient: found mon.noname-a-legacy 2024-01-23T07:33:34.392 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7f06d95f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.116:6789/0 2024-01-23T07:33:34.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0717c0 con 0x7fccac072550 2024-01-23T07:33:34.393 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4041568432 0 0) 0x7fcca0001670 con 0x7fccac072550 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: dump: 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.394 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] but i'm connected to v1:172.21.15.116:6789/0, reconnecting 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 >> v1:172.21.15.116:6789/0 conn(0x7fccac072550 legacy=0x7fccac13bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc94003970 0x7fcc94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): picked mon.c con 0x7fcc94003970 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc940047c0 0x7fcc94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): picked mon.b con 0x7fcc940047c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc940052a0 0x7fcc9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): picked mon.a con 0x7fcc940052a0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac06fe20 con 0x7fcc940052a0 2024-01-23T07:33:34.395 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9400c1a0 con 0x7fcc940047c0 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc9400c360 con 0x7fcc94003970 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.364+0000 7fccaaffd640 10 monclient(hunting): _finish_auth 0 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.365+0000 7f46de20b640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d81db210 0x7f46d812f640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b410 tx=0x7f46d400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.365+0000 7f46ce7fc640 10 client.?.objecter ms_handle_connect 0x7f46d81db210 2024-01-23T07:33:34.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.365+0000 7f46ce7fc640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.397 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.365+0000 7f72dc36b640 1 Processor -- start 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.365+0000 7f72dc36b640 1 -- start start 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.365+0000 7f72dc36b640 10 monclient: init 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient: _add_conns ranks=[1,4,2,3,0] 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f72d40a96e0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f72d413faa0 0x7f72d40b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient(hunting): picked mon.noname-c con 0x7f72d413faa0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d4145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient(hunting): picked mon.noname-b con 0x7f72d4145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d40aac10 con 0x7f72d40a96e0 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d40a9e00 con 0x7f72d413faa0 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40a9ac0 con 0x7f72d4145600 2024-01-23T07:33:34.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.366+0000 7f72dc36b640 10 monclient(hunting): authenticate will time out at 2421.724664s 2024-01-23T07:33:34.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 10 monclient(hunting): handle_auth_done global_id 14252 payload 824 2024-01-23T07:33:34.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 1 -- 172.21.15.116:0/2582107303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d406c460 msgr2=0x7f06d4142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.399 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06d406c460 0x7f06d4142520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 1 -- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d40b37b0 msgr2=0x7f06d4144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06d40b37b0 0x7f06d4144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.367+0000 7f06d95f6640 1 -- 172.21.15.116:0/2582107303 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c00094d0 con 0x7f06d413f1b0 2024-01-23T07:33:34.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.368+0000 7fca89694640 1 --2- 172.21.15.116:0/2678868261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca840a9ce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca84074e70 tx=0x7fca7c02be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5659b2bbdc653d84 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.371+0000 7fccb0d66640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc940052a0 0x7fcc9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.372+0000 7f72da107640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f72d40a96e0 0x7f72d413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42326/0 (socket says 172.21.15.116:42326) 2024-01-23T07:33:34.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.372+0000 7f72da107640 1 -- 172.21.15.116:0/539628459 learned_addr learned my addr 172.21.15.116:0/539628459 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:34.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fccb0d66640 10 monclient(hunting): get_auth_request con 0x7fcc940052a0 auth_method 0 2024-01-23T07:33:34.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fccb0d66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fccb0d66640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fccb0d66640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:33:34.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 1 -- 172.21.15.116:0/2619632841 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a002da10 con 0x7ff5b00ac810 2024-01-23T07:33:34.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: dump: 2024-01-23T07:33:34.402 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5b6f64640 5 monclient: authenticate success, global_id 4288 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5b6f64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 1 -- 172.21.15.116:0/2619632841 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a002db70 con 0x7ff5b00ac810 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5b6f64640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5b6f64640 4 set_mon_vals no callback set 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 1 -- 172.21.15.116:0/2619632841 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0035440 con 0x7ff5b00ac810 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7ff5af7fe640 10 monclient: dump: 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.404 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 1 -- 172.21.15.116:0/198951356 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef402c9f0 con 0x7fbefc0b18b0 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: dump: 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.405 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 1 -- 172.21.15.116:0/198951356 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef402cb50 con 0x7fbefc0b18b0 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 1 -- 172.21.15.116:0/198951356 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40343f0 con 0x7fbefc0b18b0 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbefaffd640 10 monclient: dump: 2024-01-23T07:33:34.406 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbf022c5640 5 monclient: authenticate success, global_id 4314 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbf022c5640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.407 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.373+0000 7fbf022c5640 4 set_mon_vals no callback set 2024-01-23T07:33:34.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fccb0d66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fccb0d66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fccb0d66640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T07:33:34.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f06d95f6640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d413f1b0 0x7f06d41daf40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00b990 tx=0x7f06cc00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f06d17fa640 10 client.?.objecter ms_handle_connect 0x7f06d413f1b0 2024-01-23T07:33:34.408 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f06d17fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 10 monclient: shutdown 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 1 -- 172.21.15.116:0/2619632841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b00ac810 msgr2=0x7ff5b00acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 1 --2- 172.21.15.116:0/2619632841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b00ac810 0x7ff5b00acbf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00091e0 tx=0x7ff5a002cc60 comp rx=0 tx=0).stop 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 1 -- 172.21.15.116:0/2619632841 shutdown_connections 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 1 --2- 172.21.15.116:0/2619632841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b00ac810 0x7ff5b00acbf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 1 -- 172.21.15.116:0/2619632841 >> 172.21.15.116:0/2619632841 conn(0x7ff5b00b0320 msgr2=0x7ff5b00b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 1 -- 172.21.15.116:0/2619632841 shutdown_connections 2024-01-23T07:33:34.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7ff5b6f64640 1 -- 172.21.15.116:0/2619632841 wait complete. 2024-01-23T07:33:34.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 10 monclient: shutdown 2024-01-23T07:33:34.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 -- 172.21.15.116:0/198951356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 msgr2=0x7fbefc06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 --2- 172.21.15.116:0/198951356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc06e0e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0b56e0 tx=0x7fbef402be50 comp rx=0 tx=0).stop 2024-01-23T07:33:34.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 -- 172.21.15.116:0/198951356 shutdown_connections 2024-01-23T07:33:34.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 --2- 172.21.15.116:0/198951356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc06e0e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 --2- 172.21.15.116:0/198951356 >> v2:172.21.15.173:3300/0 conn(0x7fbefc149fc0 0x7fbefc06dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 -- 172.21.15.116:0/198951356 >> 172.21.15.116:0/198951356 conn(0x7fbefc0b7bb0 msgr2=0x7fbefc0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 -- 172.21.15.116:0/198951356 shutdown_connections 2024-01-23T07:33:34.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7fbf022c5640 1 -- 172.21.15.116:0/198951356 wait complete. 2024-01-23T07:33:34.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4011830 con 0x7f46d81db210 2024-01-23T07:33:34.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f46ce7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f46ce7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.412 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f46ce7fc640 10 monclient: dump: 2024-01-23T07:33:34.412 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.412 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f46ce7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f46ce7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.374+0000 7f46ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d40119b0 con 0x7f46d81db210 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46ce7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4011d60 con 0x7f46d81db210 2024-01-23T07:33:34.413 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46ce7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46ce7fc640 10 monclient: dump: 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 5 monclient: authenticate success, global_id 14249 2024-01-23T07:33:34.414 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 10 monclient: _renew_subs 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d813b280 con 0x7f46d81db210 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46cffff640 4 set_mon_vals no callback set 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 10 client.14249.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 10 monclient: _renew_subs 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d8133550 con 0x7f46d81db210 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7f46dfc6e640 1 librados: init done 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7fbf022c5640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7fbf022c5640 10 monclient: monmap: 2024-01-23T07:33:34.415 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.416 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7ff5b6f64640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7ff5b6f64640 10 monclient: monmap: 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7ff5b6f64640 1 librados: starting msgr at 2024-01-23T07:33:34.417 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7ff5b6f64640 1 librados: starting objecter 2024-01-23T07:33:34.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7fbf022c5640 1 librados: starting msgr at 2024-01-23T07:33:34.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7fbf022c5640 1 librados: starting objecter 2024-01-23T07:33:34.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7ff5b6f64640 1 Processor -- start 2024-01-23T07:33:34.418 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.375+0000 7fbf022c5640 1 Processor -- start 2024-01-23T07:33:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 -- start start 2024-01-23T07:33:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 librados: setting wanted keys 2024-01-23T07:33:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 librados: calling monclient init 2024-01-23T07:33:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient: init 2024-01-23T07:33:34.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7f46dfc6e640 10 client.14249.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7f46dfc6e640 15 client.14249.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7f46dfc6e640 20 client.14249.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7f46dfc6e640 10 client.14249.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.420 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7fbf022c5640 1 -- start start 2024-01-23T07:33:34.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7f46dfc6e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46d814a7a0 con 0x7f46d81db210 2024-01-23T07:33:34.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7fbf022c5640 1 librados: setting wanted keys 2024-01-23T07:33:34.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7fbf022c5640 1 librados: calling monclient init 2024-01-23T07:33:34.421 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7fbf022c5640 10 monclient: init 2024-01-23T07:33:34.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7fccab7fe640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc940047c0 0x7fcc94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.422 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5b00ac810 0x7ff5b01390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): picked mon.noname-c con 0x7ff5b00ac810 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5b013b600 0x7ff5b01395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): picked mon.noname-a con 0x7ff5b013b600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b013ba40 0x7ff5b01df030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): picked mon.noname-b con 0x7ff5b013ba40 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0070e80 con 0x7ff5b013b600 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b01d3260 con 0x7ff5b013ba40 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b0139b30 con 0x7ff5b00ac810 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.423 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.376+0000 7ff5b6f64640 10 monclient(hunting): authenticate will time out at 2421.735154s 2024-01-23T07:33:34.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T07:33:34.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc1419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccab7fe640 10 monclient(hunting): get_auth_request con 0x7fcc940047c0 auth_method 0 2024-01-23T07:33:34.424 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccab7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccab7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:33:34.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 10 monclient(hunting): handle_auth_done global_id 4311 payload 293 2024-01-23T07:33:34.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): picked mon.noname-a con 0x7fbefc0b18b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbefc149be0 0x7fbefc13e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.425 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 1 -- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc94003970 msgr2=0x7fcc94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc94003970 0x7fcc94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 1 -- 172.21.15.116:0/1861142637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc940047c0 msgr2=0x7fcc94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcc940047c0 0x7fcc94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 1 monclient: found mon.a 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 1 -- 172.21.15.116:0/1861142637 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0717c0 con 0x7fcc940052a0 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): picked mon.noname-c con 0x7fbefc149be0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbefc149fc0 0x7fbefc13e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): picked mon.noname-b con 0x7fbefc149fc0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc14b320 con 0x7fbefc0b18b0 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc14bc70 con 0x7fbefc149fc0 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc14bec0 con 0x7fbefc149be0 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fbf022c5640 10 monclient(hunting): authenticate will time out at 2421.735692s 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb0d66640 1 -- 172.21.15.116:0/1861142637 reap_dead start 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb27c9640 5 monclient: authenticate success, global_id 4311 2024-01-23T07:33:34.428 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.377+0000 7fccb27c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 1 -- 172.21.15.116:0/1067097767 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60402ca80 con 0x7fc60c0b0e40 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 10 monclient: dump: 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.429 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc61319d640 5 monclient: authenticate success, global_id 4300 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc61319d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 1 -- 172.21.15.116:0/1067097767 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60402cbe0 con 0x7fc60c0b0e40 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc60b7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.430 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7f72d9906640 1 --2- 172.21.15.116:0/539628459 >> v2:172.21.15.173:3300/0 conn(0x7f72d413faa0 0x7f72d40b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc61319d640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.380+0000 7fc61319d640 4 set_mon_vals no callback set 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc60b7fe640 1 -- 172.21.15.116:0/1067097767 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6040343f0 con 0x7fc60c0b0e40 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc60b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc60b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc60b7fe640 10 monclient: dump: 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.431 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fbefbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc1419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.433 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fccb0d66640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc940052a0 0x7fcc9400b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcca4007f60 tx=0x7fcc940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e40926789aa8f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 10 monclient: shutdown 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 1 -- 172.21.15.116:0/1067097767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0b0e40 msgr2=0x7fc60c13e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 1 --2- 172.21.15.116:0/1067097767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0b0e40 0x7fc60c13e410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc604009e50 tx=0x7fc60402bee0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 1 -- 172.21.15.116:0/1067097767 shutdown_connections 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 1 --2- 172.21.15.116:0/1067097767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0b0e40 0x7fc60c13e410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 1 -- 172.21.15.116:0/1067097767 >> 172.21.15.116:0/1067097767 conn(0x7fc60c0b0320 msgr2=0x7fc60c0b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 1 -- 172.21.15.116:0/1067097767 shutdown_connections 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fc61319d640 1 -- 172.21.15.116:0/1067097767 wait complete. 2024-01-23T07:33:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7ff5affff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5b013b600 0x7ff5b01395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 1 -- 172.21.15.116:0/2678868261 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c02cbe0 con 0x7fca840a9900 2024-01-23T07:33:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: dump: 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.436 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 1 -- 172.21.15.116:0/2678868261 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c02cd40 con 0x7fca840a9900 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 1 -- 172.21.15.116:0/2678868261 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c034660 con 0x7fca840a9900 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca7bfff640 10 monclient: dump: 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.437 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.438 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca8b8f8640 5 monclient: authenticate success, global_id 4294 2024-01-23T07:33:34.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca8b8f8640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.381+0000 7fca8b8f8640 4 set_mon_vals no callback set 2024-01-23T07:33:34.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc1419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54506/0 (socket says 172.21.15.116:54506) 2024-01-23T07:33:34.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 1 -- 172.21.15.116:0/4195007645 learned_addr learned my addr 172.21.15.116:0/4195007645 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 10 monclient(hunting): get_auth_request con 0x7fbefc0b18b0 auth_method 0 2024-01-23T07:33:34.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.439 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 10 monclient: monmap: 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 1 librados: starting msgr at 2024-01-23T07:33:34.440 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 1 librados: starting objecter 2024-01-23T07:33:34.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 10 monclient: shutdown 2024-01-23T07:33:34.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 1 -- 172.21.15.116:0/2678868261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 msgr2=0x7fca840a9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 1 --2- 172.21.15.116:0/2678868261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca840a9ce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca84074e70 tx=0x7fca7c02be30 comp rx=0 tx=0).stop 2024-01-23T07:33:34.441 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7f72d9906640 10 monclient(hunting): get_auth_request con 0x7f72d413faa0 auth_method 0 2024-01-23T07:33:34.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7f72d9906640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7f72d9906640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7f72d9906640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fbefbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.442 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 1 Processor -- start 2024-01-23T07:33:34.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 1 -- 172.21.15.116:0/2678868261 shutdown_connections 2024-01-23T07:33:34.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 1 --2- 172.21.15.116:0/2678868261 >> v2:172.21.15.116:3300/0 conn(0x7fca840ac250 0x7fca84143830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 1 --2- 172.21.15.116:0/2678868261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca840a9ce0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.443 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 1 -- 172.21.15.116:0/2678868261 >> 172.21.15.116:0/2678868261 conn(0x7fca840b0320 msgr2=0x7fca840b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 1 -- start start 2024-01-23T07:33:34.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 1 librados: setting wanted keys 2024-01-23T07:33:34.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 1 librados: calling monclient init 2024-01-23T07:33:34.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fc61319d640 10 monclient: init 2024-01-23T07:33:34.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.382+0000 7fca8b8f8640 1 -- 172.21.15.116:0/2678868261 shutdown_connections 2024-01-23T07:33:34.444 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fca8b8f8640 1 -- 172.21.15.116:0/2678868261 wait complete. 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fca8b8f8640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fca8b8f8640 10 monclient: monmap: 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.445 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:34.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0ac810 0x7fc60c148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): picked mon.noname-b con 0x7fc60c0ac810 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7f72d9906640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.446 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7f72d9906640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c0b0e40 0x7fc60c13f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): picked mon.noname-a con 0x7fc60c0b0e40 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc60c13e950 0x7fc60c13fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): picked mon.noname-c con 0x7fc60c13e950 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c14a060 con 0x7fc60c0b0e40 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c149320 con 0x7fc60c0ac810 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c14a2d0 con 0x7fc60c13e950 2024-01-23T07:33:34.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7f72d9906640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fc61319d640 10 monclient(hunting): authenticate will time out at 2421.742076s 2024-01-23T07:33:34.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fca8b8f8640 1 librados: starting msgr at 2024-01-23T07:33:34.448 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.383+0000 7fca8b8f8640 1 librados: starting objecter 2024-01-23T07:33:34.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7ff5affff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5b013b600 0x7ff5b01395f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54504/0 (socket says 172.21.15.116:54504) 2024-01-23T07:33:34.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7ff5affff640 1 -- 172.21.15.116:0/3019555221 learned_addr learned my addr 172.21.15.116:0/3019555221 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7ff5affff640 10 monclient(hunting): get_auth_request con 0x7ff5b013b600 auth_method 0 2024-01-23T07:33:34.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7ff5affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7ff5affff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7ff5affff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 Processor -- start 2024-01-23T07:33:34.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 -- start start 2024-01-23T07:33:34.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 librados: setting wanted keys 2024-01-23T07:33:34.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 librados: calling monclient init 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient: init 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca84145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): picked mon.noname-b con 0x7fca840a9900 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca840aab80 0x7fca8413ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): picked mon.noname-c con 0x7fca840aab80 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca840ac250 0x7fca8413f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): picked mon.noname-a con 0x7fca840ac250 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84140460 con 0x7fca840ac250 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84140690 con 0x7fca840a9900 2024-01-23T07:33:34.451 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8413e7c0 con 0x7fca840aab80 2024-01-23T07:33:34.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.384+0000 7fca8b8f8640 10 monclient(hunting): authenticate will time out at 2421.742910s 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.385+0000 7f72d9105640 1 -- 172.21.15.116:0/539628459 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247713187 0 0) 0x7f72d40aac10 con 0x7f72d40a96e0 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.385+0000 7f72d9105640 10 monclient(hunting): _negotiate 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.385+0000 7f72d9105640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.385+0000 7f72d9105640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.385+0000 7f72d9105640 10 monclient(hunting): my global_id is 4309 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.385+0000 7f72d9105640 1 -- 172.21.15.116:0/539628459 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c0003520 con 0x7f72d40a96e0 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 10 monclient(hunting): handle_auth_done global_id 4312 payload 274 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 1 -- 172.21.15.116:0/539628459 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 msgr2=0x7f72d4145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 1 --2- 172.21.15.116:0/539628459 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d4145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 1 -- 172.21.15.116:0/539628459 >> v1:172.21.15.173:6789/0 conn(0x7f72d40a96e0 legacy=0x7f72d413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.453 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.387+0000 7f72d9906640 1 -- 172.21.15.116:0/539628459 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40aae80 con 0x7f72d413faa0 2024-01-23T07:33:34.454 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 10 monclient(hunting): handle_auth_done global_id 4320 payload 824 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 1 -- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbefc149be0 msgr2=0x7fbefc13e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbefc149be0 0x7fbefc13e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 1 -- 172.21.15.116:0/4195007645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbefc149fc0 msgr2=0x7fbefc13e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbefc149fc0 0x7fbefc13e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 1 monclient: found mon.noname-a 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.455 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7fbefbfff640 1 -- 172.21.15.116:0/4195007645 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef4009b30 con 0x7fbefc0b18b0 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7ff5b5501640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b013ba40 0x7ff5b01df030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7ff5affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7ff5affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.388+0000 7ff5affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.389+0000 7ff5b5501640 10 monclient(hunting): get_auth_request con 0x7ff5b013ba40 auth_method 0 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.389+0000 7ff5b5501640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.389+0000 7ff5b5501640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.389+0000 7ff5b5501640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.456 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.390+0000 7ff5b5501640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.390+0000 7ff5b5501640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.390+0000 7ff5b5501640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.457 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.390+0000 7f72d9906640 1 --2- 172.21.15.116:0/539628459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d413faa0 0x7f72d40b1850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009790 tx=0x7f72c402b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b2bbb499b90141 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca4035400 con 0x7fcc940052a0 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 10 monclient: dump: 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.458 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca4035560 con 0x7fcc940052a0 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccb27c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 1 -- 172.21.15.116:0/1861142637 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca40358d0 con 0x7fcc940052a0 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccaaffd640 10 monclient: dump: 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.459 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccb27c9640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.391+0000 7fccb27c9640 4 set_mon_vals no callback set 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 10 monclient: shutdown 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 1 -- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc940052a0 msgr2=0x7fcc9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc940052a0 0x7fcc9400b980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcca4007f60 tx=0x7fcc940057f0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 1 -- 172.21.15.116:0/1861142637 shutdown_connections 2024-01-23T07:33:34.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 1 --2- 172.21.15.116:0/1861142637 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc940052a0 0x7fcc9400b980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 1 -- 172.21.15.116:0/1861142637 >> 172.21.15.116:0/1861142637 conn(0x7fccac06b7a0 msgr2=0x7fccac06bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 1 -- 172.21.15.116:0/1861142637 shutdown_connections 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.392+0000 7fccb27c9640 1 -- 172.21.15.116:0/1861142637 wait complete. 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 10 monclient(hunting): handle_auth_done global_id 4315 payload 824 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 1 -- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5b00ac810 msgr2=0x7ff5b01390b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ff5b00ac810 0x7ff5b01390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 1 -- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5b013b600 msgr2=0x7ff5b01395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5b013b600 0x7ff5b01395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 1 monclient: found mon.noname-b 2024-01-23T07:33:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.462 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7ff5b5501640 1 -- 172.21.15.116:0/3019555221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009d60 con 0x7ff5b013ba40 2024-01-23T07:33:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7fccb27c9640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7fccb27c9640 10 monclient: monmap: 2024-01-23T07:33:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.463 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7fccb27c9640 1 librados: starting msgr at 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.393+0000 7fccb27c9640 1 librados: starting objecter 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 Processor -- start 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 -- start start 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 librados: setting wanted keys 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 librados: calling monclient init 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient: init 2024-01-23T07:33:34.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc940052a0 0x7fccac142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): picked mon.noname-c con 0x7fcc940052a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccac13fe40 0x7fccac1d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): picked mon.noname-b con 0x7fccac13fe40 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccac0a9470 0x7fccac136b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): picked mon.noname-a con 0x7fccac0a9470 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac0aa990 con 0x7fccac0a9470 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac1427d0 con 0x7fccac13fe40 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac142410 con 0x7fcc940052a0 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.394+0000 7fccb27c9640 10 monclient(hunting): authenticate will time out at 2421.753021s 2024-01-23T07:33:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.395+0000 7fbefbfff640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc1419c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00c410 tx=0x7fbeec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.395+0000 7fbef8ff9640 10 client.?.objecter ms_handle_connect 0x7fbefc0b18b0 2024-01-23T07:33:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.395+0000 7fbef8ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.395+0000 7ff5b5501640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b013ba40 0x7ff5b01df030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400b3e0 tx=0x7ff5a400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.395+0000 7ff5ad7fa640 10 client.?.objecter ms_handle_connect 0x7ff5b013ba40 2024-01-23T07:33:34.466 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.395+0000 7ff5ad7fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.399+0000 7fca89694640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca84145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f46d401a400 con 0x7f46d81db210 2024-01-23T07:33:34.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7fc610f39640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0ac810 0x7fc60c148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7fca89694640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca84145c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37736/0 (socket says 172.21.15.116:37736) 2024-01-23T07:33:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7fca89694640 1 -- 172.21.15.116:0/1964733107 learned_addr learned my addr 172.21.15.116:0/1964733107 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7fca89694640 10 monclient(hunting): get_auth_request con 0x7fca840a9900 auth_method 0 2024-01-23T07:33:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7fca89694640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7fca89694640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7fca89694640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7f46ce7fc640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46bc06c8b0 0x7f46bc06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.402+0000 7f46dda0a640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46bc06c8b0 0x7f46bc06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7f46dda0a640 10 monclient: get_auth_request con 0x7f46bc06c8b0 auth_method 0 2024-01-23T07:33:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7f46dda0a640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46bc06c8b0 0x7f46bc06ed70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46c8036000 tx=0x7f46c803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7f46ce7fc640 10 client.14249.objecter ms_handle_connect 0x7f46bc06c8b0 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0035f0 con 0x7fbefc0b18b0 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: dump: 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.470 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec003750 con 0x7fbefc0b18b0 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec003b00 con 0x7fbefc0b18b0 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbef8ff9640 10 monclient: dump: 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.471 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.472 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fc60bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c0b0e40 0x7fc60c13f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbf022c5640 5 monclient: authenticate success, global_id 4320 2024-01-23T07:33:34.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbf022c5640 10 monclient: _renew_subs 2024-01-23T07:33:34.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbefa7fc640 4 set_mon_vals no callback set 2024-01-23T07:33:34.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fca89e95640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca840ac250 0x7fca8413f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbf022c5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc14c1a0 con 0x7fbefc0b18b0 2024-01-23T07:33:34.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbf022c5640 10 client.4320.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbf022c5640 10 monclient: _renew_subs 2024-01-23T07:33:34.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.403+0000 7fbf022c5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc142040 con 0x7fbefc0b18b0 2024-01-23T07:33:34.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 1 librados: init done 2024-01-23T07:33:34.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fca89694640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fca89694640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fca89694640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fc610f39640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0ac810 0x7fc60c148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37728/0 (socket says 172.21.15.116:37728) 2024-01-23T07:33:34.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fc610f39640 1 -- 172.21.15.116:0/2630165623 learned_addr learned my addr 172.21.15.116:0/2630165623 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fc610f39640 10 monclient(hunting): get_auth_request con 0x7fc60c0ac810 auth_method 0 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fc610f39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fc610f39640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fc610f39640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 10 client.4320.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 15 client.4320.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 20 client.4320.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 10 client.4320.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.404+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbefc142230 con 0x7fbefc0b18b0 2024-01-23T07:33:34.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fccab7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccac13fe40 0x7fccac1d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fc60bfff640 10 monclient(hunting): get_auth_request con 0x7fc60c0b0e40 auth_method 0 2024-01-23T07:33:34.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fc60bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fc60bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fc60bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f46d4058dc0 con 0x7f46d81db210 2024-01-23T07:33:34.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 10 client.14249.objecter ms_dispatch 0x7f46d8000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 3 client.14249.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 3 client.14249.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fccab7fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccac13fe40 0x7fccac1d31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37750/0 (socket says 172.21.15.116:37750) 2024-01-23T07:33:34.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fccab7fe640 1 -- 172.21.15.116:0/1223293069 learned_addr learned my addr 172.21.15.116:0/1223293069 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fccab7fe640 10 monclient(hunting): get_auth_request con 0x7fccac13fe40 auth_method 0 2024-01-23T07:33:34.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fccab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fccab7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7fccab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 10 client.14249.objecter checking command 1 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7f46bc072c00 0x7f46bc075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 20 client.14249.objecter _get_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 20 client.14249.objecter put_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 15 client.14249.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 20 client.14249.objecter _get_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 20 client.14249.objecter get_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 15 client.14249.objecter _session_command_op_assign 4 1 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 20 client.14249.objecter put_session s=0x7f46bc072530 osd=4 4 2024-01-23T07:33:34.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 10 client.14249.objecter _send_command 1 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 --> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46bc0756d0 con 0x7f46bc072c00 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.405+0000 7f46ce7fc640 20 client.14249.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.406+0000 7f46dd209640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7f46bc072c00 0x7f46bc075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.406+0000 7f46dd209640 10 monclient: get_auth_request con 0x7f46bc072c00 auth_method 0 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d4054a00 con 0x7f46d81db210 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7f46ce7fc640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 10 monclient(hunting): handle_auth_done global_id 4318 payload 824 2024-01-23T07:33:34.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 1 -- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca840aab80 msgr2=0x7fca8413ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fca840aab80 0x7fca8413ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 1 -- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca840ac250 msgr2=0x7fca8413f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca840ac250 0x7fca8413f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 1 monclient: found mon.noname-b 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fca89694640 1 -- 172.21.15.116:0/1964733107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c009a70 con 0x7fca840a9900 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fc610f39640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fc610f39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.408+0000 7fc610f39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.410+0000 7f46dd209640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7f46bc072c00 0x7f46bc075020 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.410+0000 7f46ce7fc640 10 client.14249.objecter ms_handle_connect 0x7f46bc072c00 2024-01-23T07:33:34.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.411+0000 7fca89694640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca84145c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009e80 tx=0x7fca7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.411+0000 7fca79ffb640 10 client.?.objecter ms_handle_connect 0x7fca840a9900 2024-01-23T07:33:34.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.411+0000 7fca79ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.412+0000 7fccab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.412+0000 7fccab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.412+0000 7fccab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.412+0000 7fc61173a640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc60c13e950 0x7fc60c13fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.412+0000 7fc60bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.412+0000 7fc60bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.412+0000 7fc60bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.413+0000 7fc61173a640 10 monclient(hunting): get_auth_request con 0x7fc60c13e950 auth_method 0 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.413+0000 7fc61173a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.413+0000 7fc61173a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.413+0000 7fc61173a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.414+0000 7fc61173a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.414+0000 7fc61173a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.414+0000 7fc61173a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 10 monclient(hunting): handle_auth_done global_id 4321 payload 824 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 1 -- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc60c13e950 msgr2=0x7fc60c13fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc60c13e950 0x7fc60c13fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 1 -- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c0b0e40 msgr2=0x7fc60c13f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc60c0b0e40 0x7fc60c13f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 1 monclient: found mon.noname-b 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.415+0000 7fc610f39640 1 -- 172.21.15.116:0/2630165623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604009b30 con 0x7fc60c0ac810 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc00cba0 con 0x7f06d413f1b0 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: dump: 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.487 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc00cd00 con 0x7f06d413f1b0 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 1 -- 172.21.15.116:0/539628459 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4031800 con 0x7f72d413faa0 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d2ffd640 4 set_mon_vals no callback set 2024-01-23T07:33:34.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: dump: 2024-01-23T07:33:34.489 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72dc36b640 5 monclient: authenticate success, global_id 4312 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72dc36b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 1 -- 172.21.15.116:0/539628459 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4031960 con 0x7f72d413faa0 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72dc36b640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72dc36b640 4 set_mon_vals no callback set 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 1 -- 172.21.15.116:0/539628459 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4031800 con 0x7f72d413faa0 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f72d9105640 10 monclient: dump: 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.491 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.492 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.492 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d9df7640 5 monclient: authenticate success, global_id 14252 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc014680 con 0x7f06d413f1b0 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d9df7640 10 monclient: _renew_subs 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d9df7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d41440f0 con 0x7f06d413f1b0 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.418+0000 7f06d17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d17fa640 10 monclient: dump: 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.493 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 10 client.14252.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 10 monclient: _renew_subs 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d41db660 con 0x7f06d413f1b0 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 1 librados: init done 2024-01-23T07:33:34.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 10 monclient: shutdown 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 1 -- 172.21.15.116:0/539628459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d413faa0 msgr2=0x7f72d40b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 1 --2- 172.21.15.116:0/539628459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d413faa0 0x7f72d40b1850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009790 tx=0x7f72c402b8a0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 10 client.14252.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 15 client.14252.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 20 client.14252.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 10 client.14252.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f06d414c7e0 con 0x7f06d413f1b0 2024-01-23T07:33:34.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 1 -- 172.21.15.116:0/539628459 shutdown_connections 2024-01-23T07:33:34.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 1 --2- 172.21.15.116:0/539628459 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d4145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 1 --2- 172.21.15.116:0/539628459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d413faa0 0x7f72d40b1850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 1 -- 172.21.15.116:0/539628459 >> 172.21.15.116:0/539628459 conn(0x7f72d40b7bb0 msgr2=0x7f72d40b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.419+0000 7f72dc36b640 1 -- 172.21.15.116:0/539628459 shutdown_connections 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.420+0000 7f72dc36b640 1 -- 172.21.15.116:0/539628459 wait complete. 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.420+0000 7f72dc36b640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.420+0000 7f72dc36b640 10 monclient: monmap: 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.420+0000 7f72dc36b640 1 librados: starting msgr at 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.420+0000 7f72dc36b640 1 librados: starting objecter 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 Processor -- start 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 -- start start 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 librados: setting wanted keys 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 librados: calling monclient init 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient: init 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d40a96e0 0x7f72d4138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): picked mon.noname-b con 0x7f72d40a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72d413faa0 0x7f72d41427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): picked mon.noname-a con 0x7f72d413faa0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d41404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): picked mon.noname-c con 0x7f72d4145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4141d70 con 0x7f72d413faa0 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d413ffa0 con 0x7f72d40a96e0 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d4142d20 con 0x7f72d4145600 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.421+0000 7f72dc36b640 10 monclient(hunting): authenticate will time out at 2421.780097s 2024-01-23T07:33:34.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 10 monclient(hunting): handle_auth_done global_id 4324 payload 824 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 1 -- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc940052a0 msgr2=0x7fccac142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcc940052a0 0x7fccac142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 1 -- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccac0a9470 msgr2=0x7fccac136b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccac0a9470 0x7fccac136b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 1 monclient: found mon.noname-b 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.422+0000 7fccab7fe640 1 -- 172.21.15.116:0/1223293069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac0a9950 con 0x7fccac13fe40 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c02cb80 con 0x7fca840a9900 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: dump: 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.503 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c03f630 con 0x7fca840a9900 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c03f9e0 con 0x7fca840a9900 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca79ffb640 10 monclient: dump: 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.504 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca7b7fe640 4 set_mon_vals no callback set 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 5 monclient: authenticate success, global_id 4318 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 10 monclient: _renew_subs 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8413deb0 con 0x7fca840a9900 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 10 client.4318.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 10 monclient: _renew_subs 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca84140c60 con 0x7fca840a9900 2024-01-23T07:33:34.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.426+0000 7fca8b8f8640 1 librados: init done 2024-01-23T07:33:34.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fccab7fe640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccac13fe40 0x7fccac1d31c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e800 tx=0x7fcca000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fcca8ff9640 10 client.?.objecter ms_handle_connect 0x7fccac13fe40 2024-01-23T07:33:34.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fcca8ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fc610f39640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0ac810 0x7fc60c148710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c410 tx=0x7fc60000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fc6097fa640 10 client.?.objecter ms_handle_connect 0x7fc60c0ac810 2024-01-23T07:33:34.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fc6097fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fca8b8f8640 10 client.4318.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fca8b8f8640 15 client.4318.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fca8b8f8640 20 client.4318.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fca8b8f8640 10 client.4318.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fca8b8f8640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca84150e20 con 0x7fca840a9900 2024-01-23T07:33:34.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.427+0000 7f72da908640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d41404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.429+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbeec003c60 con 0x7fbefc0b18b0 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.429+0000 7fbef8ff9640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbee806c860 0x7fbee806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.429+0000 7fbefb7fe640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbee806c860 0x7fbee806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.429+0000 7fbefb7fe640 10 monclient: get_auth_request con 0x7fbee806c860 auth_method 0 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.430+0000 7fbef8ff9640 10 client.4320.objecter ms_handle_connect 0x7fbee806c860 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.430+0000 7fbefb7fe640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbee806c860 0x7fbee806ed20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbefc1416e0 tx=0x7fbef0006bf0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbeec057e40 con 0x7fbefc0b18b0 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 10 client.4320.objecter ms_dispatch 0x7fbefc000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 3 client.4320.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 3 client.4320.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 10 client.4320.objecter checking command 1 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7fbee8072c40 0x7fbee8075060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 20 client.4320.objecter _get_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 20 client.4320.objecter put_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 15 client.4320.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 20 client.4320.objecter _get_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 20 client.4320.objecter get_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 15 client.4320.objecter _session_command_op_assign 7 1 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 20 client.4320.objecter put_session s=0x7fbee8072570 osd=7 4 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 10 client.4320.objecter _send_command 1 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 --> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbee8075710 con 0x7fbee8072c40 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.440+0000 7fbef8ff9640 20 client.4320.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.441+0000 7fbf00862640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7fbee8072c40 0x7fbee8075060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.441+0000 7fbf00862640 10 monclient: get_auth_request con 0x7fbee8072c40 auth_method 0 2024-01-23T07:33:34.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.446+0000 7fbef8ff9640 10 client.4320.objecter ms_handle_connect 0x7fbee8072c40 2024-01-23T07:33:34.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.446+0000 7fbf00862640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7fbee8072c40 0x7fbee8075060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.450+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f06cc01d3b0 con 0x7f06d413f1b0 2024-01-23T07:33:34.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f06d17fa640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f06b806c8b0 0x7f06b806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f06d8df5640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f06b806c8b0 0x7f06b806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f06d8df5640 10 monclient: get_auth_request con 0x7f06b806c8b0 auth_method 0 2024-01-23T07:33:34.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f72da908640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d41404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:40358/0 (socket says 172.21.15.116:40358) 2024-01-23T07:33:34.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f72da908640 1 -- 172.21.15.116:0/1777808045 learned_addr learned my addr 172.21.15.116:0/1777808045 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f72da908640 10 monclient(hunting): get_auth_request con 0x7f72d4145600 auth_method 0 2024-01-23T07:33:34.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f72da908640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f72da908640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f72da908640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f06d8df5640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f06b806c8b0 0x7f06b806ed70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009710 tx=0x7f06c8006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.451+0000 7f06d17fa640 10 client.14252.objecter ms_handle_connect 0x7f06b806c8b0 2024-01-23T07:33:34.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.452+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fca7c03fb40 con 0x7fca840a9900 2024-01-23T07:33:34.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.452+0000 7fca79ffb640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fca6806c8b0 0x7fca6806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.453+0000 7fca88e93640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fca6806c8b0 0x7fca6806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.453+0000 7fca88e93640 10 monclient: get_auth_request con 0x7fca6806c8b0 auth_method 0 2024-01-23T07:33:34.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.453+0000 7fca79ffb640 10 client.4318.objecter ms_handle_connect 0x7fca6806c8b0 2024-01-23T07:33:34.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.453+0000 7fca88e93640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fca6806c8b0 0x7fca6806ed70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca841402b0 tx=0x7fca80007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f06cc059040 con 0x7f06d413f1b0 2024-01-23T07:33:34.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 10 client.14252.objecter ms_dispatch 0x7f06d4000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 3 client.14252.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 3 client.14252.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 10 client.14252.objecter checking command 1 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f06b8072c90 0x7f06b80750b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 20 client.14252.objecter _get_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 20 client.14252.objecter put_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 15 client.14252.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 20 client.14252.objecter _get_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 20 client.14252.objecter get_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 15 client.14252.objecter _session_command_op_assign 2 1 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 20 client.14252.objecter put_session s=0x7f06b80725c0 osd=2 4 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 10 client.14252.objecter _send_command 1 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 --> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f06b8075760 con 0x7f06b8072c90 2024-01-23T07:33:34.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 20 client.14252.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06cc054c80 con 0x7f06d413f1b0 2024-01-23T07:33:34.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f06d17fa640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f72da908640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f72da908640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.456+0000 7f72da908640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.517 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.457+0000 7f06d3fff640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f06b8072c90 0x7f06b80750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.457+0000 7f06d3fff640 10 monclient: get_auth_request con 0x7f06b8072c90 auth_method 0 2024-01-23T07:33:34.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7f72d9906640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72d413faa0 0x7f72d41427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fca7c07b6d0 con 0x7fca840a9900 2024-01-23T07:33:34.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 10 client.4318.objecter ms_dispatch 0x7fca84000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 3 client.4318.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbeec053a80 con 0x7fbefc0b18b0 2024-01-23T07:33:34.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fbef8ff9640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 3 client.4318.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 10 client.4318.objecter checking command 1 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fca68072c90 0x7fca680750b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 20 client.4318.objecter _get_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 20 client.4318.objecter put_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 15 client.4318.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 20 client.4318.objecter _get_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 20 client.4318.objecter get_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 15 client.4318.objecter _session_command_op_assign 5 1 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 20 client.4318.objecter put_session s=0x7fca680725c0 osd=5 4 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 10 client.4318.objecter _send_command 1 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 --> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca68075760 con 0x7fca68072c90 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 20 client.4318.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca7c077310 con 0x7fca840a9900 2024-01-23T07:33:34.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.459+0000 7fca79ffb640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7f72d9906640 10 monclient(hunting): get_auth_request con 0x7f72d413faa0 auth_method 0 2024-01-23T07:33:34.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7f72d9906640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7f72d9906640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7f72d9906640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7f72d9906640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7f72d9906640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7f72d9906640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.460+0000 7fca89e95640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fca68072c90 0x7fca680750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7fca89e95640 10 monclient: get_auth_request con 0x7fca68072c90 auth_method 0 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 10 monclient(hunting): handle_auth_done global_id 14258 payload 824 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 1 -- 172.21.15.116:0/1777808045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d40a96e0 msgr2=0x7f72d4138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72d40a96e0 0x7f72d4138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 1 -- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72d413faa0 msgr2=0x7f72d41427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f72d413faa0 0x7f72d41427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.523 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f72da908640 1 -- 172.21.15.116:0/1777808045 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40093a0 con 0x7f72d4145600 2024-01-23T07:33:34.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f06d3fff640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f06b8072c90 0x7f06b80750b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.461+0000 7f06d17fa640 10 client.14252.objecter ms_handle_connect 0x7f06b8072c90 2024-01-23T07:33:34.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.463+0000 7fca79ffb640 10 client.4318.objecter ms_handle_connect 0x7fca68072c90 2024-01-23T07:33:34.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.463+0000 7fca89e95640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fca68072c90 0x7fca680750b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000c850 con 0x7fccac13fe40 2024-01-23T07:33:34.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:34.525 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: dump: 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000c9f0 con 0x7fccac13fe40 2024-01-23T07:33:34.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 5 monclient: authenticate success, global_id 4324 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 10 monclient: _renew_subs 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac1d3700 con 0x7fccac13fe40 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccaa7fc640 4 set_mon_vals no callback set 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000cda0 con 0x7fccac13fe40 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fcca8ff9640 10 monclient: dump: 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.527 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 10 client.4324.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 10 monclient: _renew_subs 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac137040 con 0x7fccac13fe40 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.464+0000 7fccb27c9640 1 librados: init done 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7fccb27c9640 10 client.4324.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7fccb27c9640 15 client.4324.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7fccb27c9640 20 client.4324.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7fccb27c9640 10 client.4324.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7fccb27c9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccac0aab00 con 0x7fccac13fe40 2024-01-23T07:33:34.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7f72da908640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d41404c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b9e0 tx=0x7f72cc00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7f72caffd640 10 client.?.objecter ms_handle_connect 0x7f72d4145600 2024-01-23T07:33:34.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.465+0000 7f72caffd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011830 con 0x7ff5b013ba40 2024-01-23T07:33:34.530 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 10 monclient: dump: 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.531 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 5 monclient: authenticate success, global_id 4315 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 10 monclient: _renew_subs 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5b01df570 con 0x7ff5b013ba40 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 10 client.4315.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 10 monclient: _renew_subs 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b01dfa50 con 0x7ff5b013ba40 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5b6f64640 1 librados: init done 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4011990 con 0x7ff5b013ba40 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.532 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.467+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4011830 con 0x7ff5b013ba40 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5ad7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5ad7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5ad7fa640 10 monclient: dump: 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5aeffd640 4 set_mon_vals no callback set 2024-01-23T07:33:34.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5b6f64640 10 client.4315.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5b6f64640 15 client.4315.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5b6f64640 20 client.4315.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5b6f64640 10 client.4315.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5b6f64640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.468+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff590002910 con 0x7ff5b013ba40 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6000035f0 con 0x7fc60c0ac810 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: dump: 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.535 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 5 monclient: authenticate success, global_id 4321 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 10 monclient: _renew_subs 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c14a5b0 con 0x7fc60c0ac810 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 10 client.4321.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 10 monclient: _renew_subs 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c071c10 con 0x7fc60c0ac810 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc61319d640 1 librados: init done 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600003750 con 0x7fc60c0ac810 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600003b40 con 0x7fc60c0ac810 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc6097fa640 10 monclient: dump: 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.537 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.476+0000 7fc60affd640 4 set_mon_vals no callback set 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.477+0000 7fc61319d640 10 client.4321.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.477+0000 7fc61319d640 15 client.4321.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.477+0000 7fc61319d640 20 client.4321.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.477+0000 7fc61319d640 10 client.4321.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.477+0000 7fc61319d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.477+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc60c0b0060 con 0x7fc60c0ac810 2024-01-23T07:33:34.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00caa0 con 0x7f72d4145600 2024-01-23T07:33:34.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: dump: 2024-01-23T07:33:34.539 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.539 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.539 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc00cc20 con 0x7f72d4145600 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc014440 con 0x7f72d4145600 2024-01-23T07:33:34.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 5 monclient: authenticate success, global_id 14258 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72d8904640 4 set_mon_vals no callback set 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72caffd640 10 monclient: dump: 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.541 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 10 monclient: _renew_subs 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d4136230 con 0x7f72d4145600 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 10 client.14258.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 10 monclient: _renew_subs 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d4140be0 con 0x7f72d4145600 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.484+0000 7f72dc36b640 1 librados: init done 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.485+0000 7f72dc36b640 10 client.14258.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.485+0000 7f72dc36b640 15 client.14258.objecter _session_command_op_assign -1 1 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.485+0000 7f72dc36b640 20 client.14258.objecter _get_session osd=-1 returning homeless 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.485+0000 7f72dc36b640 10 client.14258.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.485+0000 7f72dc36b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.485+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72d4142f50 con 0x7f72d4145600 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.489+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== osd.4 v2:172.21.15.173:6806/3961996474 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f46bc0756d0 con 0x7f46bc072c00 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.489+0000 7f46ce7fc640 10 client.14249.objecter ms_dispatch 0x7f46d8000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.489+0000 7f46ce7fc640 10 client.14249.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.489+0000 7f46ce7fc640 20 client.14249.objecter put_session s=0x7f46bc072530 osd=4 4 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.489+0000 7f46ce7fc640 15 client.14249.objecter _session_command_op_remove 4 1 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.496+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== osd.7 v2:172.21.15.173:6824/1205985563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbee8075710 con 0x7fbee8072c40 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.496+0000 7fbef8ff9640 10 client.4320.objecter ms_dispatch 0x7fbefc000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.496+0000 7fbef8ff9640 10 client.4320.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.496+0000 7fbef8ff9640 20 client.4320.objecter put_session s=0x7fbee8072570 osd=7 4 2024-01-23T07:33:34.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.496+0000 7fbef8ff9640 15 client.4320.objecter _session_command_op_remove 7 1 2024-01-23T07:33:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.502+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcca001d460 con 0x7fccac13fe40 2024-01-23T07:33:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.503+0000 7fcca8ff9640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcc9806c890 0x7fcc9806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.503+0000 7fccabfff640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcc9806c890 0x7fcc9806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.503+0000 7fccabfff640 10 monclient: get_auth_request con 0x7fcc9806c890 auth_method 0 2024-01-23T07:33:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.503+0000 7fccabfff640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcc9806c890 0x7fcc9806ed50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c001600 tx=0x7fcc9c007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.503+0000 7fcca8ff9640 10 client.4324.objecter ms_handle_connect 0x7fcc9806c890 2024-01-23T07:33:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcca0059290 con 0x7fccac13fe40 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 10 client.4324.objecter ms_dispatch 0x7fccac000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 3 client.4324.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 3 client.4324.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 10 client.4324.objecter checking command 1 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7fcc98072c70 0x7fcc98075090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 20 client.4324.objecter _get_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 20 client.4324.objecter put_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 15 client.4324.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 20 client.4324.objecter _get_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 20 client.4324.objecter get_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 15 client.4324.objecter _session_command_op_assign 3 1 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 20 client.4324.objecter put_session s=0x7fcc980725a0 osd=3 4 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 10 client.4324.objecter _send_command 1 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc98075740 con 0x7fcc98072c70 2024-01-23T07:33:34.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 20 client.4324.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcca0054ed0 con 0x7fccac13fe40 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.508+0000 7fcca8ff9640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.509+0000 7fccb0d66640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7fcc98072c70 0x7fcc98075090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7fccb0d66640 10 monclient: get_auth_request con 0x7fcc98072c70 auth_method 0 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 10 client.14249.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 15 client.14249.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 20 client.14249.objecter _get_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 20 client.14249.objecter put_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 20 client.14249.objecter _get_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 15 client.14249.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 20 client.14249.objecter get_session s=0x7f46bc072530 osd=4 3 2024-01-23T07:33:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 15 client.14249.objecter _session_command_op_assign 4 2 2024-01-23T07:33:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 20 client.14249.objecter put_session s=0x7f46bc072530 osd=4 4 2024-01-23T07:33:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 10 client.14249.objecter _send_command 2 2024-01-23T07:33:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.510+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 --> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46d814a7a0 con 0x7f46bc072c00 2024-01-23T07:33:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 10 client.4320.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 15 client.4320.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 20 client.4320.objecter _get_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 20 client.4320.objecter put_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 20 client.4320.objecter _get_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 15 client.4320.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 20 client.4320.objecter get_session s=0x7fbee8072570 osd=7 3 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 15 client.4320.objecter _session_command_op_assign 7 2 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 20 client.4320.objecter put_session s=0x7fbee8072570 osd=7 4 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 10 client.4320.objecter _send_command 2 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.512+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 --> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbefc14b160 con 0x7fbee8072c40 2024-01-23T07:33:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.515+0000 7fccb0d66640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7fcc98072c70 0x7fcc98075090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.515+0000 7fcca8ff9640 10 client.4324.objecter ms_handle_connect 0x7fcc98072c70 2024-01-23T07:33:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.517+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f72cc0145a0 con 0x7f72d4145600 2024-01-23T07:33:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.517+0000 7f72caffd640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72b806c8b0 0x7f72b806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.518+0000 7f72da107640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72b806c8b0 0x7f72b806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.518+0000 7f72da107640 10 monclient: get_auth_request con 0x7f72b806c8b0 auth_method 0 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.518+0000 7f72caffd640 10 client.14258.objecter ms_handle_connect 0x7f72b806c8b0 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.518+0000 7f72da107640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72b806c8b0 0x7f72b806ed70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72d0001610 tx=0x7f72d0007930 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f72cc058810 con 0x7f72d4145600 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 10 client.14258.objecter ms_dispatch 0x7f72d4000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 3 client.14258.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 3 client.14258.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== osd.2 v2:172.21.15.116:6826/2848377313 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f06b8075760 con 0x7f06b8072c90 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f06d17fa640 10 client.14252.objecter ms_dispatch 0x7f06d4000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f06d17fa640 10 client.14252.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 10 client.14258.objecter checking command 1 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f72b8072c90 0x7f72b80750b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 20 client.14258.objecter _get_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 20 client.14258.objecter put_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 15 client.14258.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 20 client.14258.objecter _get_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 20 client.14258.objecter get_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 15 client.14258.objecter _session_command_op_assign 6 1 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 20 client.14258.objecter put_session s=0x7f72b80725c0 osd=6 4 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 10 client.14258.objecter _send_command 1 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 --> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72b8075760 con 0x7f72b8072c90 2024-01-23T07:33:34.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 20 client.14258.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72cc054b50 con 0x7f72d4145600 2024-01-23T07:33:34.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f72caffd640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f06d17fa640 20 client.14252.objecter put_session s=0x7f06b80725c0 osd=2 4 2024-01-23T07:33:34.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.524+0000 7f06d17fa640 15 client.14252.objecter _session_command_op_remove 2 1 2024-01-23T07:33:34.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.525+0000 7f72d9906640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f72b8072c90 0x7f72b80750b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.525+0000 7f72d9906640 10 monclient: get_auth_request con 0x7f72b8072c90 auth_method 0 2024-01-23T07:33:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.526+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== osd.5 v2:172.21.15.173:6800/1137022367 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fca68075760 con 0x7fca68072c90 2024-01-23T07:33:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.526+0000 7fca79ffb640 10 client.4318.objecter ms_dispatch 0x7fca84000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.526+0000 7fca79ffb640 10 client.4318.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.526+0000 7fca79ffb640 20 client.4318.objecter put_session s=0x7fca680725c0 osd=5 4 2024-01-23T07:33:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.526+0000 7fca79ffb640 15 client.4318.objecter _session_command_op_remove 5 1 2024-01-23T07:33:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46ce7fc640 1 -- 172.21.15.116:0/2867398437 <== osd.4 v2:172.21.15.173:6806/3961996474 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46d0001a00 con 0x7f46bc072c00 2024-01-23T07:33:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46ce7fc640 10 client.14249.objecter ms_dispatch 0x7f46d8000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46ce7fc640 10 client.14249.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46ce7fc640 20 client.14249.objecter put_session s=0x7f46bc072530 osd=4 4 2024-01-23T07:33:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46ce7fc640 15 client.14249.objecter _session_command_op_remove 4 2 2024-01-23T07:33:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 10 librados: watch_flush enter 2024-01-23T07:33:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 10 librados: watch_flush exit 2024-01-23T07:33:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 10 client.14249.objecter close_session for osd.4 2024-01-23T07:33:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7f46bc072c00 msgr2=0x7f46bc075020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7f46bc072c00 0x7f46bc075020 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 20 client.14249.objecter put_session s=0x7f46bc072530 osd=4 1 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 20 client.14249.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.527+0000 7f46dfc6e640 10 client.14249.objecter successfully canceled tick 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46bc06c8b0 msgr2=0x7f46bc06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46bc06c8b0 0x7f46bc06ed70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46c8036000 tx=0x7f46c803b040 comp rx=0 tx=0).stop 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 10 monclient: shutdown 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d81db210 msgr2=0x7f46d812f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 --2- 172.21.15.116:0/2867398437 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46d81db210 0x7f46d812f640 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46d400b410 tx=0x7f46d400b8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46de20b640 1 -- 172.21.15.116:0/2867398437 reap_dead start 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 shutdown_connections 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 >> 172.21.15.116:0/2867398437 conn(0x7f46d80b0320 msgr2=0x7f46d8073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 shutdown_connections 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 -- 172.21.15.116:0/2867398437 wait complete. 2024-01-23T07:33:34.558 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.528+0000 7f46dfc6e640 1 librados: shutdown 2024-01-23T07:33:34.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.529+0000 7f72caffd640 10 client.14258.objecter ms_handle_connect 0x7f72b8072c90 2024-01-23T07:33:34.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.529+0000 7f72d9906640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f72b8072c90 0x7f72b80750b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbef8ff9640 1 -- 172.21.15.116:0/4195007645 <== osd.7 v2:172.21.15.173:6824/1205985563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbefc14b160 con 0x7fbee8072c40 2024-01-23T07:33:34.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbef8ff9640 10 client.4320.objecter ms_dispatch 0x7fbefc000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbef8ff9640 10 client.4320.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbef8ff9640 20 client.4320.objecter put_session s=0x7fbee8072570 osd=7 4 2024-01-23T07:33:34.559 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbef8ff9640 15 client.4320.objecter _session_command_op_remove 7 2 2024-01-23T07:33:34.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 10 librados: watch_flush enter 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 10 librados: watch_flush exit 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 10 client.4320.objecter close_session for osd.7 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7fbee8072c40 msgr2=0x7fbee8075060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7fbee8072c40 0x7fbee8075060 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 20 client.4320.objecter put_session s=0x7fbee8072570 osd=7 1 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 20 client.4320.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 10 client.4320.objecter successfully canceled tick 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbee806c860 msgr2=0x7fbee806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbee806c860 0x7fbee806ed20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbefc1416e0 tx=0x7fbef0006bf0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 10 monclient: shutdown 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 msgr2=0x7fbefc1419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.532+0000 7fbf022c5640 1 --2- 172.21.15.116:0/4195007645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbefc0b18b0 0x7fbefc1419c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00c410 tx=0x7fbeec00c8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.533+0000 7fbf00862640 1 -- 172.21.15.116:0/4195007645 reap_dead start 2024-01-23T07:33:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.533+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 shutdown_connections 2024-01-23T07:33:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.533+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 >> 172.21.15.116:0/4195007645 conn(0x7fbefc0b7bb0 msgr2=0x7fbefc0b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.533+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 shutdown_connections 2024-01-23T07:33:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.533+0000 7fbf022c5640 1 -- 172.21.15.116:0/4195007645 wait complete. 2024-01-23T07:33:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.533+0000 7fbf022c5640 1 librados: shutdown 2024-01-23T07:33:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.538+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ff5a4011b00 con 0x7ff5b013ba40 2024-01-23T07:33:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.538+0000 7ff5ad7fa640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ff59c06c920 0x7ff59c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.539+0000 7ff5b4d00640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ff59c06c920 0x7ff59c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.539+0000 7ff5b4d00640 10 monclient: get_auth_request con 0x7ff59c06c920 auth_method 0 2024-01-23T07:33:34.563 INFO:teuthology.orchestra.run.smithi116.stdout:77309411337 2024-01-23T07:33:34.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-23T07:33:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.539+0000 7ff5b4d00640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ff59c06c920 0x7ff59c06ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0037000 tx=0x7ff5a002f000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.539+0000 7ff5ad7fa640 10 client.4315.objecter ms_handle_connect 0x7ff59c06c920 2024-01-23T07:33:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff5a4058a70 con 0x7ff5b013ba40 2024-01-23T07:33:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 10 client.4315.objecter ms_dispatch 0x7ff5b0000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 3 client.4315.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 3 client.4315.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 10 client.4315.objecter checking command 1 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7ff59c072d00 0x7ff59c075120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 20 client.4315.objecter _get_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 20 client.4315.objecter put_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 15 client.4315.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 20 client.4315.objecter _get_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 20 client.4315.objecter get_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 15 client.4315.objecter _session_command_op_assign 0 1 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 20 client.4315.objecter put_session s=0x7ff59c072630 osd=0 4 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 10 client.4315.objecter _send_command 1 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 --> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff59c0757d0 con 0x7ff59c072d00 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 20 client.4315.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5a4011830 con 0x7ff5b013ba40 2024-01-23T07:33:34.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5ad7fa640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.542+0000 7ff5affff640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7ff59c072d00 0x7ff59c075120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.543+0000 7ff5affff640 10 monclient: get_auth_request con 0x7ff59c072d00 auth_method 0 2024-01-23T07:33:34.567 INFO:teuthology.orchestra.run.smithi116.stdout:64424509448 2024-01-23T07:33:34.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-23T07:33:34.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.546+0000 7ff5ad7fa640 10 client.4315.objecter ms_handle_connect 0x7ff59c072d00 2024-01-23T07:33:34.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.546+0000 7ff5affff640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7ff59c072d00 0x7ff59c075120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc600003ca0 con 0x7fc60c0ac810 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 10 client.14252.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 15 client.14252.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 20 client.14252.objecter _get_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 20 client.14252.objecter put_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 20 client.14252.objecter _get_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 15 client.14252.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 20 client.14252.objecter get_session s=0x7f06b80725c0 osd=2 3 2024-01-23T07:33:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 15 client.14252.objecter _session_command_op_assign 2 2 2024-01-23T07:33:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 20 client.14252.objecter put_session s=0x7f06b80725c0 osd=2 4 2024-01-23T07:33:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 10 client.14252.objecter _send_command 2 2024-01-23T07:33:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.554+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 --> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f06d40b2bd0 con 0x7f06b8072c90 2024-01-23T07:33:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.555+0000 7fc6097fa640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5f806c860 0x7fc5f806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.555+0000 7fc60bfff640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5f806c860 0x7fc5f806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.555+0000 7fc60bfff640 10 monclient: get_auth_request con 0x7fc5f806c860 auth_method 0 2024-01-23T07:33:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.555+0000 7fc6097fa640 10 client.4321.objecter ms_handle_connect 0x7fc5f806c860 2024-01-23T07:33:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.555+0000 7fc60bfff640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5f806c860 0x7fc5f806ed20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc604035000 tx=0x7fc604030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc6000010c0 con 0x7fc60c0ac810 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 10 client.4321.objecter ms_dispatch 0x7fc60c000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 3 client.4321.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 3 client.4321.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 10 client.4321.objecter checking command 1 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fc5f8072c40 0x7fc5f8075060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 20 client.4321.objecter _get_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 20 client.4321.objecter put_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 15 client.4321.objecter _session_command_op_remove -1 1 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 20 client.4321.objecter _get_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 20 client.4321.objecter get_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 15 client.4321.objecter _session_command_op_assign 1 1 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 20 client.4321.objecter put_session s=0x7fc5f8072570 osd=1 4 2024-01-23T07:33:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 10 client.4321.objecter _send_command 1 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 --> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5f8075710 con 0x7fc5f8072c40 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 20 client.4321.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc600054300 con 0x7fc60c0ac810 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.556+0000 7fc6097fa640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fc61173a640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fc5f8072c40 0x7fc5f8075060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 10 client.4318.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 15 client.4318.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 20 client.4318.objecter _get_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 20 client.4318.objecter put_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 20 client.4318.objecter _get_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 15 client.4318.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 20 client.4318.objecter get_session s=0x7fca680725c0 osd=5 3 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 15 client.4318.objecter _session_command_op_assign 5 2 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 20 client.4318.objecter put_session s=0x7fca680725c0 osd=5 4 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 10 client.4318.objecter _send_command 2 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 --> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca84069600 con 0x7fca68072c90 2024-01-23T07:33:34.574 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.557+0000 7fc61173a640 10 monclient: get_auth_request con 0x7fc5f8072c40 auth_method 0 2024-01-23T07:33:34.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.560+0000 7fc61173a640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fc5f8072c40 0x7fc5f8075060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.560+0000 7fc6097fa640 10 client.4321.objecter ms_handle_connect 0x7fc5f8072c40 2024-01-23T07:33:34.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca79ffb640 1 -- 172.21.15.116:0/1964733107 <== osd.5 v2:172.21.15.173:6800/1137022367 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca84069600 con 0x7fca68072c90 2024-01-23T07:33:34.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca79ffb640 10 client.4318.objecter ms_dispatch 0x7fca84000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca79ffb640 10 client.4318.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca79ffb640 20 client.4318.objecter put_session s=0x7fca680725c0 osd=5 4 2024-01-23T07:33:34.575 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca79ffb640 15 client.4318.objecter _session_command_op_remove 5 2 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 10 librados: watch_flush enter 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 10 librados: watch_flush exit 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 10 client.4318.objecter close_session for osd.5 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fca68072c90 msgr2=0x7fca680750b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fca68072c90 0x7fca680750b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 20 client.4318.objecter put_session s=0x7fca680725c0 osd=5 1 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 20 client.4318.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 10 client.4318.objecter successfully canceled tick 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fca6806c8b0 msgr2=0x7fca6806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fca6806c8b0 0x7fca6806ed70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fca841402b0 tx=0x7fca80007a40 comp rx=0 tx=0).stop 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 10 monclient: shutdown 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 msgr2=0x7fca84145c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 --2- 172.21.15.116:0/1964733107 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca840a9900 0x7fca84145c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fca7c009e80 tx=0x7fca7c004a40 comp rx=0 tx=0).stop 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca89e95640 1 -- 172.21.15.116:0/1964733107 reap_dead start 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 shutdown_connections 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.563+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 >> 172.21.15.116:0/1964733107 conn(0x7fca840b0320 msgr2=0x7fca8413d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.564+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 shutdown_connections 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.564+0000 7fca8b8f8640 1 -- 172.21.15.116:0/1964733107 wait complete. 2024-01-23T07:33:34.578 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.564+0000 7fca8b8f8640 1 librados: shutdown 2024-01-23T07:33:34.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d17fa640 1 -- 172.21.15.116:0/2582107303 <== osd.2 v2:172.21.15.116:6826/2848377313 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f06d40b2bd0 con 0x7f06b8072c90 2024-01-23T07:33:34.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d17fa640 10 client.14252.objecter ms_dispatch 0x7f06d4000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d17fa640 10 client.14252.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d17fa640 20 client.14252.objecter put_session s=0x7f06b80725c0 osd=2 4 2024-01-23T07:33:34.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d17fa640 15 client.14252.objecter _session_command_op_remove 2 2 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 10 librados: watch_flush enter 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 10 librados: watch_flush exit 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 10 client.14252.objecter close_session for osd.2 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f06b8072c90 msgr2=0x7f06b80750b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f06b8072c90 0x7f06b80750b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 20 client.14252.objecter put_session s=0x7f06b80725c0 osd=2 1 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 20 client.14252.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 10 client.14252.objecter successfully canceled tick 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f06b806c8b0 msgr2=0x7f06b806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f06b806c8b0 0x7f06b806ed70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009710 tx=0x7f06c8006c90 comp rx=0 tx=0).stop 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.569+0000 7f06d9df7640 10 monclient: shutdown 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d413f1b0 msgr2=0x7f06d41daf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 1 --2- 172.21.15.116:0/2582107303 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06d413f1b0 0x7f06d41daf40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06cc00b990 tx=0x7f06cc00be50 comp rx=0 tx=0).stop 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d95f6640 1 -- 172.21.15.116:0/2582107303 reap_dead start 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 shutdown_connections 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 >> 172.21.15.116:0/2582107303 conn(0x7f06d40b7a40 msgr2=0x7f06d413dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 shutdown_connections 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 1 -- 172.21.15.116:0/2582107303 wait complete. 2024-01-23T07:33:34.582 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.570+0000 7f06d9df7640 1 librados: shutdown 2024-01-23T07:33:34.583 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-01-23T07:33:34.583 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-23T07:33:34.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.577+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== osd.6 v2:172.21.15.173:6816/548415989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f72b8075760 con 0x7f72b8072c90 2024-01-23T07:33:34.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.577+0000 7f72caffd640 10 client.14258.objecter ms_dispatch 0x7f72d4000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.577+0000 7f72caffd640 10 client.14258.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.577+0000 7f72caffd640 20 client.14258.objecter put_session s=0x7f72b80725c0 osd=6 4 2024-01-23T07:33:34.584 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.577+0000 7f72caffd640 15 client.14258.objecter _session_command_op_remove 6 1 2024-01-23T07:33:34.586 INFO:teuthology.orchestra.run.smithi116.stdout:68719476742 2024-01-23T07:33:34.586 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-23T07:33:34.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.598+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== osd.3 v2:172.21.15.116:6818/1332739445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcc98075740 con 0x7fcc98072c70 2024-01-23T07:33:34.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.598+0000 7fcca8ff9640 10 client.4324.objecter ms_dispatch 0x7fccac000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.598+0000 7fcca8ff9640 10 client.4324.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.598+0000 7fcca8ff9640 20 client.4324.objecter put_session s=0x7fcc980725a0 osd=3 4 2024-01-23T07:33:34.598 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.598+0000 7fcca8ff9640 15 client.4324.objecter _session_command_op_remove 3 1 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 10 client.14258.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 15 client.14258.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 20 client.14258.objecter _get_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 20 client.14258.objecter put_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 20 client.14258.objecter _get_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 15 client.14258.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 20 client.14258.objecter get_session s=0x7f72b80725c0 osd=6 3 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 15 client.14258.objecter _session_command_op_assign 6 2 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 20 client.14258.objecter put_session s=0x7f72b80725c0 osd=6 4 2024-01-23T07:33:34.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 10 client.14258.objecter _send_command 2 2024-01-23T07:33:34.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.607+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 --> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f72d4142f50 con 0x7f72b8072c90 2024-01-23T07:33:34.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.613+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== osd.0 v2:172.21.15.116:6802/950064745 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff59c0757d0 con 0x7ff59c072d00 2024-01-23T07:33:34.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.613+0000 7ff5ad7fa640 10 client.4315.objecter ms_dispatch 0x7ff5b0000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.613+0000 7ff5ad7fa640 10 client.4315.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.613+0000 7ff5ad7fa640 20 client.4315.objecter put_session s=0x7ff59c072630 osd=0 4 2024-01-23T07:33:34.613 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.613+0000 7ff5ad7fa640 15 client.4315.objecter _session_command_op_remove 0 1 2024-01-23T07:33:34.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.615+0000 7f72caffd640 1 -- 172.21.15.116:0/1777808045 <== osd.6 v2:172.21.15.173:6816/548415989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f72d4142f50 con 0x7f72b8072c90 2024-01-23T07:33:34.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.615+0000 7f72caffd640 10 client.14258.objecter ms_dispatch 0x7f72d4000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.615+0000 7f72caffd640 10 client.14258.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.615+0000 7f72caffd640 20 client.14258.objecter put_session s=0x7f72b80725c0 osd=6 4 2024-01-23T07:33:34.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.615+0000 7f72caffd640 15 client.14258.objecter _session_command_op_remove 6 2 2024-01-23T07:33:34.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 10 librados: watch_flush enter 2024-01-23T07:33:34.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 10 librados: watch_flush exit 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 10 client.14258.objecter close_session for osd.6 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f72b8072c90 msgr2=0x7f72b80750b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f72b8072c90 0x7f72b80750b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 20 client.14258.objecter put_session s=0x7f72b80725c0 osd=6 1 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 20 client.14258.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 10 client.14258.objecter successfully canceled tick 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72b806c8b0 msgr2=0x7f72b806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f72b806c8b0 0x7f72b806ed70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f72d0001610 tx=0x7f72d0007930 comp rx=0 tx=0).stop 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 10 monclient: shutdown 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 msgr2=0x7f72d41404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72dc36b640 1 --2- 172.21.15.116:0/1777808045 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f72d4145600 0x7f72d41404c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f72cc00b9e0 tx=0x7f72cc00bea0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.616+0000 7f72da908640 1 -- 172.21.15.116:0/1777808045 reap_dead start 2024-01-23T07:33:34.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.617+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 shutdown_connections 2024-01-23T07:33:34.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.617+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 >> 172.21.15.116:0/1777808045 conn(0x7f72d40b7bb0 msgr2=0x7f72d40b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.619+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 shutdown_connections 2024-01-23T07:33:34.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.619+0000 7f72dc36b640 1 -- 172.21.15.116:0/1777808045 wait complete. 2024-01-23T07:33:34.619 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.619+0000 7f72dc36b640 1 librados: shutdown 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 10 client.4324.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 15 client.4324.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 20 client.4324.objecter _get_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 20 client.4324.objecter put_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 20 client.4324.objecter _get_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 15 client.4324.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 20 client.4324.objecter get_session s=0x7fcc980725a0 osd=3 3 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 15 client.4324.objecter _session_command_op_assign 3 2 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 20 client.4324.objecter put_session s=0x7fcc980725a0 osd=3 4 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 10 client.4324.objecter _send_command 2 2024-01-23T07:33:34.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.626+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccac071be0 con 0x7fcc98072c70 2024-01-23T07:33:34.640 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-01-23T07:33:34.641 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 10 client.4315.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 15 client.4315.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 20 client.4315.objecter _get_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 20 client.4315.objecter put_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 20 client.4315.objecter _get_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 15 client.4315.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 20 client.4315.objecter get_session s=0x7ff59c072630 osd=0 3 2024-01-23T07:33:34.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 15 client.4315.objecter _session_command_op_assign 0 2 2024-01-23T07:33:34.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 20 client.4315.objecter put_session s=0x7ff59c072630 osd=0 4 2024-01-23T07:33:34.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 10 client.4315.objecter _send_command 2 2024-01-23T07:33:34.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.642+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 --> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff590001240 con 0x7ff59c072d00 2024-01-23T07:33:34.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.649+0000 7ff5ad7fa640 1 -- 172.21.15.116:0/3019555221 <== osd.0 v2:172.21.15.116:6802/950064745 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff590001240 con 0x7ff59c072d00 2024-01-23T07:33:34.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.649+0000 7ff5ad7fa640 10 client.4315.objecter ms_dispatch 0x7ff5b0000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.649+0000 7ff5ad7fa640 10 client.4315.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.649+0000 7ff5ad7fa640 20 client.4315.objecter put_session s=0x7ff59c072630 osd=0 4 2024-01-23T07:33:34.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.649+0000 7ff5ad7fa640 15 client.4315.objecter _session_command_op_remove 0 2 2024-01-23T07:33:34.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.649+0000 7ff5b6f64640 10 librados: watch_flush enter 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 10 librados: watch_flush exit 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 10 client.4315.objecter close_session for osd.0 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7ff59c072d00 msgr2=0x7ff59c075120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7ff59c072d00 0x7ff59c075120 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 20 client.4315.objecter put_session s=0x7ff59c072630 osd=0 1 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 20 client.4315.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 10 client.4315.objecter successfully canceled tick 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ff59c06c920 msgr2=0x7ff59c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ff59c06c920 0x7ff59c06ede0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0037000 tx=0x7ff5a002f000 comp rx=0 tx=0).stop 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 10 monclient: shutdown 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b013ba40 msgr2=0x7ff5b01df030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 --2- 172.21.15.116:0/3019555221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff5b013ba40 0x7ff5b01df030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400b3e0 tx=0x7ff5a400b8a0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b5501640 1 -- 172.21.15.116:0/3019555221 reap_dead start 2024-01-23T07:33:34.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 shutdown_connections 2024-01-23T07:33:34.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.650+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 >> 172.21.15.116:0/3019555221 conn(0x7ff5b00b0320 msgr2=0x7ff5b00b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.652+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 shutdown_connections 2024-01-23T07:33:34.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.653+0000 7ff5b6f64640 1 -- 172.21.15.116:0/3019555221 wait complete. 2024-01-23T07:33:34.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.653+0000 7ff5b6f64640 1 librados: shutdown 2024-01-23T07:33:34.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.672+0000 7fcca8ff9640 1 -- 172.21.15.116:0/1223293069 <== osd.3 v2:172.21.15.116:6818/1332739445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcca4045040 con 0x7fcc98072c70 2024-01-23T07:33:34.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fcca8ff9640 10 client.4324.objecter ms_dispatch 0x7fccac000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fcca8ff9640 10 client.4324.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fcca8ff9640 20 client.4324.objecter put_session s=0x7fcc980725a0 osd=3 4 2024-01-23T07:33:34.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fcca8ff9640 15 client.4324.objecter _session_command_op_remove 3 2 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 10 librados: watch_flush enter 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 10 librados: watch_flush exit 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 10 client.4324.objecter close_session for osd.3 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7fcc98072c70 msgr2=0x7fcc98075090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7fcc98072c70 0x7fcc98075090 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 20 client.4324.objecter put_session s=0x7fcc980725a0 osd=3 1 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 20 client.4324.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.674 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 10 client.4324.objecter successfully canceled tick 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.673+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcc9806c890 msgr2=0x7fcc9806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcc9806c890 0x7fcc9806ed50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c001600 tx=0x7fcc9c007990 comp rx=0 tx=0).stop 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 10 monclient: shutdown 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccac13fe40 msgr2=0x7fccac1d31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 1 --2- 172.21.15.116:0/1223293069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fccac13fe40 0x7fccac1d31c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e800 tx=0x7fcca000ecc0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb0d66640 1 -- 172.21.15.116:0/1223293069 reap_dead start 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 shutdown_connections 2024-01-23T07:33:34.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 >> 172.21.15.116:0/1223293069 conn(0x7fccac06b7a0 msgr2=0x7fccac06e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== osd.1 v2:172.21.15.116:6810/745967066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc5f8075710 con 0x7fc5f8072c40 2024-01-23T07:33:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 shutdown_connections 2024-01-23T07:33:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fc6097fa640 10 client.4321.objecter ms_dispatch 0x7fc60c000b90 command_reply(tid 1: 0 ) v1 2024-01-23T07:33:34.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fc6097fa640 10 client.4321.objecter _finish_command 1 = system:0 2024-01-23T07:33:34.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fc6097fa640 20 client.4321.objecter put_session s=0x7fc5f8072570 osd=1 4 2024-01-23T07:33:34.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.674+0000 7fc6097fa640 15 client.4321.objecter _session_command_op_remove 1 1 2024-01-23T07:33:34.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.677+0000 7fccb27c9640 1 -- 172.21.15.116:0/1223293069 wait complete. 2024-01-23T07:33:34.682 INFO:teuthology.orchestra.run.smithi116.stdout:60129542151 2024-01-23T07:33:34.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.680+0000 7fccb27c9640 1 librados: shutdown 2024-01-23T07:33:34.682 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-23T07:33:34.700 INFO:teuthology.orchestra.run.smithi116.stdout:81604378635 2024-01-23T07:33:34.701 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-23T07:33:34.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 10 client.4321.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2024-01-23T07:33:34.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 15 client.4321.objecter _session_command_op_assign -1 2 2024-01-23T07:33:34.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 20 client.4321.objecter _get_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 20 client.4321.objecter put_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 20 client.4321.objecter _get_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 15 client.4321.objecter _session_command_op_remove -1 2 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 20 client.4321.objecter get_session s=0x7fc5f8072570 osd=1 3 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 15 client.4321.objecter _session_command_op_assign 1 2 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 20 client.4321.objecter put_session s=0x7fc5f8072570 osd=1 4 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 10 client.4321.objecter _send_command 2 2024-01-23T07:33:34.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.705+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 --> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc60c0adec0 con 0x7fc5f8072c40 2024-01-23T07:33:34.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.727+0000 7fc6097fa640 1 -- 172.21.15.116:0/2630165623 <== osd.1 v2:172.21.15.116:6810/745967066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5fc001300 con 0x7fc5f8072c40 2024-01-23T07:33:34.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.727+0000 7fc6097fa640 10 client.4321.objecter ms_dispatch 0x7fc60c000b90 command_reply(tid 2: 0 ) v1 2024-01-23T07:33:34.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.727+0000 7fc6097fa640 10 client.4321.objecter _finish_command 2 = system:0 2024-01-23T07:33:34.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.727+0000 7fc6097fa640 20 client.4321.objecter put_session s=0x7fc5f8072570 osd=1 4 2024-01-23T07:33:34.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.727+0000 7fc6097fa640 15 client.4321.objecter _session_command_op_remove 1 2 2024-01-23T07:33:34.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.728+0000 7fc61319d640 10 librados: watch_flush enter 2024-01-23T07:33:34.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 10 librados: watch_flush exit 2024-01-23T07:33:34.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 10 client.4321.objecter close_session for osd.1 2024-01-23T07:33:34.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fc5f8072c40 msgr2=0x7fc5f8075060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fc5f8072c40 0x7fc5f8075060 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 20 client.4321.objecter put_session s=0x7fc5f8072570 osd=1 1 2024-01-23T07:33:34.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 20 client.4321.objecter shutdown clearing up homeless session... 2024-01-23T07:33:34.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 10 client.4321.objecter successfully canceled tick 2024-01-23T07:33:34.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5f806c860 msgr2=0x7fc5f806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5f806c860 0x7fc5f806ed20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc604035000 tx=0x7fc604030000 comp rx=0 tx=0).stop 2024-01-23T07:33:34.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 10 monclient: shutdown 2024-01-23T07:33:34.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0ac810 msgr2=0x7fc60c148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.729+0000 7fc61319d640 1 --2- 172.21.15.116:0/2630165623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc60c0ac810 0x7fc60c148710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c410 tx=0x7fc60000c8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.731+0000 7fc61173a640 1 -- 172.21.15.116:0/2630165623 reap_dead start 2024-01-23T07:33:34.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.732+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 shutdown_connections 2024-01-23T07:33:34.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.732+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 >> 172.21.15.116:0/2630165623 conn(0x7fc60c0b0320 msgr2=0x7fc60c135470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.732+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 shutdown_connections 2024-01-23T07:33:34.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.732+0000 7fc61319d640 1 -- 172.21.15.116:0/2630165623 wait complete. 2024-01-23T07:33:34.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.732+0000 7fc61319d640 1 librados: shutdown 2024-01-23T07:33:34.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.742+0000 7f4c57fff640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.742+0000 7f4c57fff640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.742+0000 7f4c57fff640 10 monclient: monmap: 2024-01-23T07:33:34.742 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.743457+0000 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.743457+0000 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.743 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.743+0000 7f4c57fff640 1 Processor -- start 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.743+0000 7f4c57fff640 1 -- start start 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.743+0000 7f4c57fff640 10 monclient: init 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient: _add_conns ranks=[4,1,0,3,2] 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4c5806c460 0x7f4c580b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient(hunting): picked mon.noname-c con 0x7f4c5806c460 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4c580b37b0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4c5813f1b0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580b1390 con 0x7f4c5813f1b0 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580ae920 con 0x7f4c580b37b0 2024-01-23T07:33:34.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c580af650 con 0x7f4c5806c460 2024-01-23T07:33:34.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.744+0000 7f4c57fff640 10 monclient(hunting): authenticate will time out at 2422.102877s 2024-01-23T07:33:34.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.746+0000 7f4c56ffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4c5806c460 0x7f4c580b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.746+0000 7f4c56ffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f4c5806c460 0x7f4c580b0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37756/0 (socket says 172.21.15.116:37756) 2024-01-23T07:33:34.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.746+0000 7f4c56ffd640 1 -- 172.21.15.116:0/243196003 learned_addr learned my addr 172.21.15.116:0/243196003 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.746+0000 7f4c56ffd640 10 monclient(hunting): get_auth_request con 0x7f4c5806c460 auth_method 0 2024-01-23T07:33:34.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.746+0000 7f4c56ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.746+0000 7f4c56ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.746+0000 7f4c56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.747+0000 7f4c56ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.747+0000 7f4c56ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.747+0000 7f4c56ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.747+0000 7fb25cbea640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.747+0000 7fb25cbea640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.747+0000 7fb25cbea640 10 monclient: monmap: 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.749068+0000 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.749068+0000 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.749 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.750 INFO:teuthology.orchestra.run.smithi116.stdout:81604378633 2024-01-23T07:33:34.751 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-23T07:33:34.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 10 monclient(hunting): handle_auth_done global_id 4327 payload 274 2024-01-23T07:33:34.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 1 -- 172.21.15.116:0/243196003 >> v1:172.21.15.173:6789/0 conn(0x7f4c580b37b0 legacy=0x7f4c580aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 1 -- 172.21.15.116:0/243196003 >> v1:172.21.15.116:6789/0 conn(0x7f4c5813f1b0 legacy=0x7f4c5813f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7f4c56ffd640 1 -- 172.21.15.116:0/243196003 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580b41c0 con 0x7f4c5806c460 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.749+0000 7fb25cbea640 1 Processor -- start 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.750+0000 7fb25cbea640 1 -- start start 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.750+0000 7fb25cbea640 10 monclient: init 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient: _add_conns ranks=[1,3,4,0,2] 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb2581422d0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2580b0e40 0x7fb25813eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient(hunting): picked mon.noname-a con 0x7fb2580b0e40 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb25813b600 0x7fb2580ac710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient(hunting): picked mon.noname-c con 0x7fb25813b600 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2581415e0 con 0x7fb2581422d0 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580a9820 con 0x7fb2580b0e40 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580a9b50 con 0x7fb25813b600 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.751+0000 7fb25cbea640 10 monclient(hunting): authenticate will time out at 2422.109555s 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.752+0000 7fb255d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2580b0e40 0x7fb25813eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.752+0000 7fb255d9b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb2580b0e40 0x7fb25813eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54562/0 (socket says 172.21.15.116:54562) 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.752+0000 7fb255d9b640 1 -- 172.21.15.116:0/1337273582 learned_addr learned my addr 172.21.15.116:0/1337273582 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.752+0000 7fb255d9b640 10 monclient(hunting): get_auth_request con 0x7fb2580b0e40 auth_method 0 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.752+0000 7fb255d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.752+0000 7fb255d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.752+0000 7fb255d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.753+0000 7fb255d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.753+0000 7fb255d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.753+0000 7fb255d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.754+0000 7fb256d9d640 1 --2- 172.21.15.116:0/1337273582 >> v2:172.21.15.173:3300/0 conn(0x7fb25813b600 0x7fb2580ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.754+0000 7f4c56ffd640 1 --2- 172.21.15.116:0/243196003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5806c460 0x7f4c580b0e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009870 tx=0x7f4c4802b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df647cf27effab3b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.754+0000 7fb256d9d640 10 monclient(hunting): get_auth_request con 0x7fb25813b600 auth_method 0 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.754+0000 7fb256d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.754+0000 7fb256d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.754+0000 7fb256d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 10 monclient(hunting): handle_auth_done global_id 4335 payload 274 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 1 -- 172.21.15.116:0/1337273582 >> v2:172.21.15.173:3300/0 conn(0x7fb25813b600 msgr2=0x7fb2580ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 1 --2- 172.21.15.116:0/1337273582 >> v2:172.21.15.173:3300/0 conn(0x7fb25813b600 0x7fb2580ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 1 -- 172.21.15.116:0/1337273582 >> v1:172.21.15.173:6789/0 conn(0x7fb2581422d0 legacy=0x7fb25813e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 1 monclient: found mon.noname-a 2024-01-23T07:33:34.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.755+0000 7fb255d9b640 1 -- 172.21.15.116:0/1337273582 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580b0060 con 0x7fb2580b0e40 2024-01-23T07:33:34.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.760+0000 7fb255d9b640 1 --2- 172.21.15.116:0/1337273582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580b0e40 0x7fb25813eb20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2580a95b0 tx=0x7fb24c02fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98267b17ac21937 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 1 -- 172.21.15.116:0/243196003 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48030890 con 0x7f4c5806c460 2024-01-23T07:33:34.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 10 monclient: dump: 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c57fff640 5 monclient: authenticate success, global_id 4327 2024-01-23T07:33:34.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c57fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 1 -- 172.21.15.116:0/243196003 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480309f0 con 0x7f4c5806c460 2024-01-23T07:33:34.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c567fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c57fff640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.761+0000 7f4c57fff640 4 set_mon_vals no callback set 2024-01-23T07:33:34.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 10 monclient: shutdown 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 1 -- 172.21.15.116:0/243196003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5806c460 msgr2=0x7f4c580b0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 1 --2- 172.21.15.116:0/243196003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5806c460 0x7f4c580b0e50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009870 tx=0x7f4c4802b9d0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 1 -- 172.21.15.116:0/243196003 shutdown_connections 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 1 --2- 172.21.15.116:0/243196003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c5806c460 0x7f4c580b0e50 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009870 tx=0x7f4c4802b9d0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 1 -- 172.21.15.116:0/243196003 >> 172.21.15.116:0/243196003 conn(0x7f4c580b7a40 msgr2=0x7f4c580b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 1 -- 172.21.15.116:0/243196003 shutdown_connections 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.762+0000 7f4c57fff640 1 -- 172.21.15.116:0/243196003 wait complete. 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.763+0000 7f4c57fff640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 10 monclient: monmap: 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.765 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 1 librados: starting msgr at 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 1 librados: starting objecter 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 1 Processor -- start 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 1 -- start start 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 1 librados: setting wanted keys 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 1 librados: calling monclient init 2024-01-23T07:33:34.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.764+0000 7f4c57fff640 10 monclient: init 2024-01-23T07:33:34.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.765+0000 7f4c57fff640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.765+0000 7f4c57fff640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.765+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c580b37b0 0x7f4c5813e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.765+0000 7f4c57fff640 10 monclient(hunting): picked mon.noname-a con 0x7f4c580b37b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c5813f1b0 0x7f4c581358d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 10 monclient(hunting): picked mon.noname-c con 0x7f4c5813f1b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c58135ec0 0x7f4c581dab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 10 monclient(hunting): picked mon.noname-b con 0x7f4c58135ec0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581dbac0 con 0x7f4c580b37b0 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58143c90 con 0x7f4c58135ec0 2024-01-23T07:33:34.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58136350 con 0x7f4c5813f1b0 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c57fff640 10 monclient(hunting): authenticate will time out at 2422.125040s 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c5813f1b0 0x7f4c581358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.766+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c58135ec0 0x7f4c581dab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c577fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c58135ec0 0x7f4c581dab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37774/0 (socket says 172.21.15.116:37774) 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c577fe640 1 -- 172.21.15.116:0/1341929806 learned_addr learned my addr 172.21.15.116:0/1341929806 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c577fe640 10 monclient(hunting): get_auth_request con 0x7f4c58135ec0 auth_method 0 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c577fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c577fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c4ffff640 10 monclient(hunting): get_auth_request con 0x7f4c5813f1b0 auth_method 0 2024-01-23T07:33:34.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c4ffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.767+0000 7f4c4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7f4c56ffd640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c580b37b0 0x7f4c5813e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7f4c577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7f4c577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7f4c577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7fb25559a640 1 -- 172.21.15.116:0/1337273582 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c030af0 con 0x7fb2580b0e40 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7fb25559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7fb25559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7fb25559a640 10 monclient: dump: 2024-01-23T07:33:34.771 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7fb25559a640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7fb25559a640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.768+0000 7fb25559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.769+0000 7f4c4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.769+0000 7f4c4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.769+0000 7f4c4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.770+0000 7f4c577fe640 10 monclient(hunting): handle_auth_done global_id 4336 payload 824 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 1 -- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c5813f1b0 msgr2=0x7f4c581358d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c5813f1b0 0x7f4c581358d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 1 -- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c580b37b0 msgr2=0x7f4c5813e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c580b37b0 0x7f4c5813e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 1 monclient: found mon.noname-b 2024-01-23T07:33:34.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f4c577fe640 1 -- 172.21.15.116:0/1341929806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480094d0 con 0x7f4c58135ec0 2024-01-23T07:33:34.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.772+0000 7fb25559a640 1 -- 172.21.15.116:0/1337273582 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c030c50 con 0x7fb2580b0e40 2024-01-23T07:33:34.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.772+0000 7fb25559a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f327abd5640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f327abd5640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.771+0000 7f327abd5640 10 monclient: monmap: 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.773035+0000 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.773035+0000 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.775 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.773+0000 7fb25cbea640 5 monclient: authenticate success, global_id 4335 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.773+0000 7fb25cbea640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.773+0000 7fb25cbea640 4 set_mon_vals no callback set 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 10 monclient: shutdown 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 1 -- 172.21.15.116:0/1337273582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580b0e40 msgr2=0x7fb25813eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 1 --2- 172.21.15.116:0/1337273582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580b0e40 0x7fb25813eb20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2580a95b0 tx=0x7fb24c02fd40 comp rx=0 tx=0).stop 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 1 -- 172.21.15.116:0/1337273582 shutdown_connections 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 1 --2- 172.21.15.116:0/1337273582 >> v2:172.21.15.173:3300/0 conn(0x7fb25813b600 0x7fb2580ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 1 --2- 172.21.15.116:0/1337273582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2580b0e40 0x7fb25813eb20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7fb25cbea640 1 -- 172.21.15.116:0/1337273582 >> 172.21.15.116:0/1337273582 conn(0x7fb2580b0320 msgr2=0x7fb2580b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.773+0000 7f4c577fe640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c58135ec0 0x7f4c581dab70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c730 tx=0x7f4c5000cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.774+0000 7f327abd5640 1 Processor -- start 2024-01-23T07:33:34.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.775+0000 7f327abd5640 1 -- start start 2024-01-23T07:33:34.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.775+0000 7f327abd5640 10 monclient: init 2024-01-23T07:33:34.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.775+0000 7f4c54ff9640 10 client.?.objecter ms_handle_connect 0x7f4c58135ec0 2024-01-23T07:33:34.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.775+0000 7f4c54ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.775+0000 7fb25cbea640 1 -- 172.21.15.116:0/1337273582 shutdown_connections 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f3b356c5640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f3b356c5640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f3b356c5640 10 monclient: monmap: 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.777244+0000 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.777244+0000 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.779 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.780 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient: _add_conns ranks=[1,4,0,3,2] 2024-01-23T07:33:34.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f326c007270 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.780 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f326c0d0270 0x7f326c031f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient(hunting): picked mon.noname-c con 0x7f326c0d0270 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f326c031390 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326c0cf570 con 0x7f326c031390 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326c0331e0 con 0x7f326c007270 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f326c02cb20 con 0x7f326c0d0270 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7f327abd5640 10 monclient(hunting): authenticate will time out at 2422.134340s 2024-01-23T07:33:34.781 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.776+0000 7fb25cbea640 1 -- 172.21.15.116:0/1337273582 wait complete. 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 1 -- 172.21.15.116:0/1341929806 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50006d50 con 0x7f4c58135ec0 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: dump: 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.782 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 1 -- 172.21.15.116:0/1341929806 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50003970 con 0x7f4c58135ec0 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 1 -- 172.21.15.116:0/1341929806 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50006d50 con 0x7f4c58135ec0 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f4c54ff9640 10 monclient: dump: 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.783 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7f32793d2640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f326c0d0270 0x7f326c031f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f32793d2640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f326c0d0270 0x7f326c031f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37778/0 (socket says 172.21.15.116:37778) 2024-01-23T07:33:34.784 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f32793d2640 1 -- 172.21.15.116:0/212262167 learned_addr learned my addr 172.21.15.116:0/212262167 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f32793d2640 10 monclient(hunting): get_auth_request con 0x7f326c0d0270 auth_method 0 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f32793d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f32793d2640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f32793d2640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f32793d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f32793d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f32793d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7fb25cbea640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7fb25cbea640 10 monclient: monmap: 2024-01-23T07:33:34.785 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7fb25cbea640 1 librados: starting msgr at 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7fb25cbea640 1 librados: starting objecter 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 1 Processor -- start 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 1 -- start start 2024-01-23T07:33:34.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 1 librados: setting wanted keys 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 1 librados: calling monclient init 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 10 monclient: init 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2580b0e40 0x7fb258138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 10 monclient(hunting): picked mon.noname-c con 0x7fb2580b0e40 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25813b600 0x7fb258139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 10 monclient(hunting): picked mon.noname-b con 0x7fb25813b600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7fb25cbea640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2581422d0 0x7fb2581dec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 10 monclient(hunting): picked mon.noname-a con 0x7fb2581422d0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581d90d0 con 0x7fb2581422d0 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581240c0 con 0x7fb25813b600 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7f3b356c5640 1 Processor -- start 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7f3b356c5640 1 -- start start 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.777+0000 7f3b356c5640 10 monclient: init 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient: _add_conns ranks=[3,4,1,2,0] 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3b300a96e0 0x7f3b300b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient(hunting): picked mon.noname-a con 0x7f3b300a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3b3013f390 0x7f3b3013f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient(hunting): picked mon.noname-c con 0x7f3b3013f390 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f3b30145600 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b300aac10 con 0x7f3b30145600 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b300a9e00 con 0x7f3b300a96e0 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3013fd30 con 0x7f3b3013f390 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.778+0000 7f3b356c5640 10 monclient(hunting): authenticate will time out at 2422.136325s 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580705c0 con 0x7fb2580b0e40 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7fb25cbea640 10 monclient(hunting): authenticate will time out at 2422.137449s 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c557fa640 4 set_mon_vals no callback set 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 5 monclient: authenticate success, global_id 4336 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 10 monclient: _renew_subs 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c581350a0 con 0x7f4c58135ec0 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 10 client.4336.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 10 monclient: _renew_subs 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c581db290 con 0x7f4c58135ec0 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f4c57fff640 1 librados: init done 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2e7fc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3b3013f390 0x7f3b3013f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2e7fc640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f3b3013f390 0x7f3b3013f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37786/0 (socket says 172.21.15.116:37786) 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2e7fc640 1 -- 172.21.15.116:0/1868640655 learned_addr learned my addr 172.21.15.116:0/1868640655 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2e7fc640 10 monclient(hunting): get_auth_request con 0x7f3b3013f390 auth_method 0 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2e7fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2effd640 1 --2- 172.21.15.116:0/1868640655 >> v2:172.21.15.116:3300/0 conn(0x7f3b300a96e0 0x7f3b300b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2effd640 10 monclient(hunting): get_auth_request con 0x7f3b300a96e0 auth_method 0 2024-01-23T07:33:34.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2effd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.779+0000 7f3b2effd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.780+0000 7f4c57fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.780+0000 7f4c57fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.780+0000 7f4c57fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.780+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c58075de0 con 0x7f4c58135ec0 2024-01-23T07:33:34.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.780+0000 7fb256d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2581422d0 0x7fb2581dec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 10 monclient(hunting): handle_auth_done global_id 4339 payload 274 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 1 -- 172.21.15.116:0/212262167 >> v1:172.21.15.173:6789/0 conn(0x7f326c007270 legacy=0x7f326c0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 1 -- 172.21.15.116:0/212262167 >> v1:172.21.15.116:6789/0 conn(0x7f326c031390 legacy=0x7f326c0d68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:34.793 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7f32793d2640 1 -- 172.21.15.116:0/212262167 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326c030040 con 0x7f326c0d0270 2024-01-23T07:33:34.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7fb25659c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2580b0e40 0x7fb258138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7fb256d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2581422d0 0x7fb2581dec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54592/0 (socket says 172.21.15.116:54592) 2024-01-23T07:33:34.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7fb256d9d640 1 -- 172.21.15.116:0/2125081720 learned_addr learned my addr 172.21.15.116:0/2125081720 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7fb256d9d640 10 monclient(hunting): get_auth_request con 0x7fb2581422d0 auth_method 0 2024-01-23T07:33:34.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7fb256d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7fb256d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.794 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.781+0000 7fb256d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7f3b2effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7f3b2effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7f3b2effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7fb25659c640 10 monclient(hunting): get_auth_request con 0x7fb2580b0e40 auth_method 0 2024-01-23T07:33:34.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7fb25659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7fb25659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.795 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7fb25659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7f3b2e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7f3b2e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.782+0000 7f3b2e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.783+0000 7fb25659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.783+0000 7fb25659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.783+0000 7fb25659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 10 monclient(hunting): handle_auth_done global_id 4338 payload 274 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 1 -- 172.21.15.116:0/1868640655 >> v2:172.21.15.173:3300/0 conn(0x7f3b3013f390 msgr2=0x7f3b3013f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 1 --2- 172.21.15.116:0/1868640655 >> v2:172.21.15.173:3300/0 conn(0x7f3b3013f390 0x7f3b3013f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 1 -- 172.21.15.116:0/1868640655 >> v1:172.21.15.173:6789/0 conn(0x7f3b30145600 legacy=0x7f3b30145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 1 monclient: found mon.noname-a 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.785+0000 7f3b2effd640 1 -- 172.21.15.116:0/1868640655 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b300a9ac0 con 0x7f3b300a96e0 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.786+0000 7fb256d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.786+0000 7fb256d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.786+0000 7fb256d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 10 monclient(hunting): handle_auth_done global_id 14264 payload 824 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 1 -- 172.21.15.116:0/2125081720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25813b600 msgr2=0x7fb258139100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25813b600 0x7fb258139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 1 -- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2581422d0 msgr2=0x7fb2581dec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2581422d0 0x7fb2581dec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 1 monclient: found mon.noname-c 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.790+0000 7fb25659c640 1 -- 172.21.15.116:0/2125081720 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0094d0 con 0x7fb2580b0e40 2024-01-23T07:33:34.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.792+0000 7f3b2effd640 1 --2- 172.21.15.116:0/1868640655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b300a96e0 0x7f3b300b1850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b30072780 tx=0x7f3b2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98646403ec355d04 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.793+0000 7fb25659c640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2580b0e40 0x7fb258138bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb24800b410 tx=0x7fb24800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.794+0000 7fb246ffd640 10 client.?.objecter ms_handle_connect 0x7fb2580b0e40 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.794+0000 7fb246ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb246ffd640 1 -- 172.21.15.116:0/2125081720 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248004020 con 0x7fb2580b0e40 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb246ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb246ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb246ffd640 10 monclient: dump: 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.802 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb246ffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb246ffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb246ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 5 monclient: authenticate success, global_id 14264 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 10 monclient: _renew_subs 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2580713a0 con 0x7fb2580b0e40 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 10 client.14264.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 10 monclient: _renew_subs 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.803 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb258071a20 con 0x7fb2580b0e40 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.798+0000 7fb25cbea640 1 librados: init done 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.799+0000 7fb246ffd640 1 -- 172.21.15.116:0/2125081720 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb248004180 con 0x7fb2580b0e40 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.799+0000 7fb246ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.799+0000 7fb254d99640 4 set_mon_vals no callback set 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.800+0000 7fb25cbea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.800+0000 7fb246ffd640 1 -- 172.21.15.116:0/2125081720 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb248009190 con 0x7fb2580b0e40 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.800+0000 7fb246ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.800+0000 7fb246ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.800+0000 7fb246ffd640 10 monclient: dump: 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.804 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7fb25cbea640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7fb25cbea640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:34.805 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c005080 con 0x7fb2580b0e40 2024-01-23T07:33:34.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 1 -- 172.21.15.116:0/1868640655 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2002e070 con 0x7f3b300a96e0 2024-01-23T07:33:34.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:34.809 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: dump: 2024-01-23T07:33:34.809 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.810 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 1 -- 172.21.15.116:0/1868640655 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b200315a0 con 0x7f3b300a96e0 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b356c5640 5 monclient: authenticate success, global_id 4338 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b356c5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b356c5640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b356c5640 4 set_mon_vals no callback set 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 1 -- 172.21.15.116:0/1868640655 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b20031930 con 0x7f3b300a96e0 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.801+0000 7f3b2dffb640 10 monclient: dump: 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.811 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 10 monclient: shutdown 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 1 -- 172.21.15.116:0/1868640655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b300a96e0 msgr2=0x7f3b300b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 1 --2- 172.21.15.116:0/1868640655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b300a96e0 0x7f3b300b1850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3b30072780 tx=0x7f3b2002b840 comp rx=0 tx=0).stop 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 1 -- 172.21.15.116:0/1868640655 shutdown_connections 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 1 --2- 172.21.15.116:0/1868640655 >> v2:172.21.15.173:3300/0 conn(0x7f3b3013f390 0x7f3b3013f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 1 --2- 172.21.15.116:0/1868640655 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b300a96e0 0x7f3b300b1850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 1 -- 172.21.15.116:0/1868640655 >> 172.21.15.116:0/1868640655 conn(0x7f3b300b7bb0 msgr2=0x7f3b300b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:34.812 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.802+0000 7f3b356c5640 1 -- 172.21.15.116:0/1868640655 shutdown_connections 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.803+0000 7f3b356c5640 1 -- 172.21.15.116:0/1868640655 wait complete. 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.803+0000 7f3b356c5640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.803+0000 7f3b356c5640 10 monclient: monmap: 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.813 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.804+0000 7f3b356c5640 1 librados: starting msgr at 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.804+0000 7f3b356c5640 1 librados: starting objecter 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.804+0000 7f3b356c5640 1 Processor -- start 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.804+0000 7f3b356c5640 1 -- start start 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.804+0000 7f3b356c5640 1 librados: setting wanted keys 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.804+0000 7f3b356c5640 1 librados: calling monclient init 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.804+0000 7f3b356c5640 10 monclient: init 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b300a96e0 0x7f3b300b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): picked mon.noname-b con 0x7f3b300a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b3013f390 0x7f3b30138a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): picked mon.noname-c con 0x7f3b3013f390 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.814 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b30145600 0x7f3b30136050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): picked mon.noname-a con 0x7f3b30145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30138620 con 0x7f3b30145600 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30136e10 con 0x7f3b300a96e0 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30137c80 con 0x7f3b3013f390 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.805+0000 7f3b356c5640 10 monclient(hunting): authenticate will time out at 2422.164093s 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.807+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b30145600 0x7f3b30136050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.807+0000 7f3b2f7fe640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b30145600 0x7f3b30136050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54596/0 (socket says 172.21.15.116:54596) 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.807+0000 7f3b2f7fe640 1 -- 172.21.15.116:0/3504606795 learned_addr learned my addr 172.21.15.116:0/3504606795 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:34.815 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.807+0000 7f3b2f7fe640 10 monclient(hunting): get_auth_request con 0x7f3b30145600 auth_method 0 2024-01-23T07:33:34.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.807+0000 7f3b2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:34.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.807+0000 7f3b2f7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.807+0000 7f3b2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.808+0000 7f3b2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:34.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.808+0000 7f3b2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:34.816 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.808+0000 7f3b2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 10 monclient(hunting): handle_auth_done global_id 4344 payload 824 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 1 -- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b3013f390 msgr2=0x7f3b30138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b3013f390 0x7f3b30138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 1 -- 172.21.15.116:0/3504606795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b300a96e0 msgr2=0x7f3b300b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b300a96e0 0x7f3b300b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 1 monclient: found mon.noname-a 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.816+0000 7f3b2f7fe640 1 -- 172.21.15.116:0/3504606795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009400 con 0x7f3b30145600 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.817+0000 7f2d21d49640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.817+0000 7f2d21d49640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.817+0000 7f2d21d49640 10 monclient: monmap: 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.818416+0000 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.818416+0000 2024-01-23T07:33:34.818 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.818+0000 7f2d21d49640 1 Processor -- start 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.818+0000 7f2d21d49640 1 -- start start 2024-01-23T07:33:34.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.818+0000 7f2d21d49640 10 monclient: init 2024-01-23T07:33:34.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.818+0000 7f3b2f7fe640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b30145600 0x7f3b30136050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400b3e0 tx=0x7f3b2400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.818+0000 7f3b177fe640 10 client.?.objecter ms_handle_connect 0x7f3b30145600 2024-01-23T07:33:34.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.818+0000 7f3b177fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:34.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2024-01-23T07:33:34.821 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2d1c0a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2d1c13faa0 0x7f2d1c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 10 monclient(hunting): picked mon.noname-c con 0x7f2d1c13faa0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c145600 0x7f2d1c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 10 monclient(hunting): picked mon.noname-b con 0x7f2d1c145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c0aac10 con 0x7f2d1c0a96e0 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.819+0000 7f2d21d49640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c0a9e00 con 0x7f2d1c13faa0 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.820+0000 7f2d21d49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.820+0000 7f2d21d49640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0a9ac0 con 0x7f2d1c145600 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.820+0000 7f2d21d49640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.822 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.820+0000 7f2d21d49640 10 monclient(hunting): authenticate will time out at 2422.178419s 2024-01-23T07:33:34.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.824+0000 7f2d1b7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f2d1c0a96e0 0x7f2d1c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48520/0 (socket says 172.21.15.116:48520) 2024-01-23T07:33:34.824 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.824+0000 7f2d1b7fe640 1 -- 172.21.15.116:0/4167181684 learned_addr learned my addr 172.21.15.116:0/4167181684 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:34.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.825+0000 7fb246ffd640 1 -- 172.21.15.116:0/2125081720 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb248011630 con 0x7fb2580b0e40 2024-01-23T07:33:34.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.825+0000 7fb246ffd640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb23806c860 0x7fb23806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.825+0000 7fb255d9b640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb23806c860 0x7fb23806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.825+0000 7fb255d9b640 10 monclient: get_auth_request con 0x7fb23806c860 auth_method 0 2024-01-23T07:33:34.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7fb255d9b640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb23806c860 0x7fb23806ed20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb24c03a000 tx=0x7fb24c032000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7fb246ffd640 10 client.14264.objecter ms_handle_connect 0x7fb23806c860 2024-01-23T07:33:34.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b177fe640 1 -- 172.21.15.116:0/3504606795 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24011830 con 0x7f3b30145600 2024-01-23T07:33:34.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b177fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:34.827 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b177fe640 10 monclient: dump: 2024-01-23T07:33:34.827 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b177fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b177fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:34.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 5 monclient: authenticate success, global_id 4344 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 10 monclient: _renew_subs 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 1 -- 172.21.15.116:0/3504606795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b30146320 con 0x7f3b30145600 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 10 monclient: _renew_subs 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 1 -- 172.21.15.116:0/3504606795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b30136590 con 0x7f3b30145600 2024-01-23T07:33:34.829 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.826+0000 7f3b356c5640 1 librados: init done 2024-01-23T07:33:34.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.827+0000 7f3b177fe640 1 -- 172.21.15.116:0/3504606795 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24011990 con 0x7f3b30145600 2024-01-23T07:33:34.830 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.827+0000 7f3b177fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.827+0000 7f3b177fe640 1 -- 172.21.15.116:0/3504606795 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24011d40 con 0x7f3b30145600 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.827+0000 7f3b177fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.827+0000 7f3b177fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.827+0000 7f3b177fe640 10 monclient: dump: 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:34.831 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.827+0000 7f3b2d7fa640 4 set_mon_vals no callback set 2024-01-23T07:33:34.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.828+0000 7f3b157fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.828+0000 7f3b157fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:34.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.828+0000 7f3b157fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:34.832 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.828+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08005080 con 0x7f3b30145600 2024-01-23T07:33:34.840 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.840+0000 7f2d1a7fc640 1 -- 172.21.15.116:0/4167181684 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159194323 0 0) 0x7f2d1c0aac10 con 0x7f2d1c0a96e0 2024-01-23T07:33:34.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.840+0000 7f2d1a7fc640 10 monclient(hunting): _negotiate 2024-01-23T07:33:34.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.840+0000 7f2d1a7fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:34.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.840+0000 7f2d1a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:34.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.840+0000 7f2d1a7fc640 10 monclient(hunting): my global_id is 4347 2024-01-23T07:33:34.841 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.840+0000 7f2d1a7fc640 1 -- 172.21.15.116:0/4167181684 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d04003520 con 0x7f2d1c0a96e0 2024-01-23T07:33:34.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.855+0000 7fa6342f1640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.855+0000 7fa6342f1640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.855+0000 7fa6342f1640 10 monclient: monmap: 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.856239+0000 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.856239+0000 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.856 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.855+0000 7fa6342f1640 1 Processor -- start 2024-01-23T07:33:34.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.855+0000 7fa6342f1640 1 -- start start 2024-01-23T07:33:34.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.855+0000 7fa6342f1640 10 monclient: init 2024-01-23T07:33:34.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2024-01-23T07:33:34.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa62c0a96e0 0x7fa62c1427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient(hunting): picked mon.noname-b con 0x7fa62c0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa62c0a9ac0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa62c13fb30 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:34.858 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0aa880 con 0x7fa62c0a9ac0 2024-01-23T07:33:34.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62c0aaad0 con 0x7fa62c13fb30 2024-01-23T07:33:34.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0aadb0 con 0x7fa62c0a96e0 2024-01-23T07:33:34.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.859 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.856+0000 7fa6342f1640 10 monclient(hunting): authenticate will time out at 2422.214768s 2024-01-23T07:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.867+0000 7f3d4c059640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.867+0000 7f3d4c059640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.867+0000 7f3d4c059640 10 monclient: monmap: 2024-01-23T07:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.867 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.868225+0000 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.868225+0000 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.867+0000 7f3d4c059640 1 Processor -- start 2024-01-23T07:33:34.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.867+0000 7f3d4c059640 1 -- start start 2024-01-23T07:33:34.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.867+0000 7f3d4c059640 10 monclient: init 2024-01-23T07:33:34.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f3d440a96e0 0x7f3d440b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient(hunting): picked mon.noname-a con 0x7f3d440a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3d4413f390 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d44145600 0x7f3d44145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient(hunting): picked mon.noname-b con 0x7f3d44145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d440aac10 con 0x7f3d4413f390 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d440a9e00 con 0x7f3d440a96e0 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440a9ac0 con 0x7f3d44145600 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.868+0000 7f3d4c059640 10 monclient(hunting): authenticate will time out at 2422.226747s 2024-01-23T07:33:34.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.875+0000 7f3b177fe640 1 -- 172.21.15.116:0/3504606795 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3b2401a400 con 0x7f3b30145600 2024-01-23T07:33:34.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.876+0000 7f3b177fe640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3b1c06c8b0 0x7f3b1c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.876+0000 7f3b2effd640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3b1c06c8b0 0x7f3b1c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:34.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.876+0000 7f3b2effd640 10 monclient: get_auth_request con 0x7f3b1c06c8b0 auth_method 0 2024-01-23T07:33:34.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.876+0000 7f3b2effd640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3b1c06c8b0 0x7f3b1c06ed70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b20036000 tx=0x7f3b20030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:34.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.876+0000 7f3b177fe640 10 client.4344.objecter ms_handle_connect 0x7f3b1c06c8b0 2024-01-23T07:33:34.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.879+0000 7f3b177fe640 1 -- 172.21.15.116:0/3504606795 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3b24058940 con 0x7f3b30145600 2024-01-23T07:33:34.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.879+0000 7f3b177fe640 10 client.4344.objecter ms_dispatch 0x7f3b30000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:34.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.879+0000 7f3b177fe640 3 client.4344.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:34.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.879+0000 7f3b177fe640 3 client.4344.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:34.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.879+0000 7f3b177fe640 20 client.4344.objecter dump_active .. 0 homeless 2024-01-23T07:33:34.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.899+0000 7f6dcd46e640 10 monclient: get_monmap_and_config 2024-01-23T07:33:34.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.899+0000 7f6dcd46e640 10 monclient: build_initial_monmap 2024-01-23T07:33:34.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.899+0000 7f6dcd46e640 10 monclient: monmap: 2024-01-23T07:33:34.900 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:34.900 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:34.900865+0000 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:34.900865+0000 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.900+0000 7f6dcd46e640 1 Processor -- start 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.900+0000 7f6dcd46e640 1 -- start start 2024-01-23T07:33:34.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.900+0000 7f6dcd46e640 10 monclient: init 2024-01-23T07:33:34.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:34.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient: _add_conns ranks=[0,4,3,1,2] 2024-01-23T07:33:34.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6dc80a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:34.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6dc813faa0 0x7f6dc80b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient(hunting): picked mon.noname-c con 0x7f6dc813faa0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:34.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6dc8145600 0x7f6dc8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient(hunting): picked mon.noname-a con 0x7f6dc8145600 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc80aac10 con 0x7f6dc80a96e0 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc80a9e00 con 0x7f6dc8145600 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dc80a9ac0 con 0x7f6dc813faa0 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:34.904 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:34.901+0000 7f6dcd46e640 10 monclient(hunting): authenticate will time out at 2422.259453s 2024-01-23T07:33:35.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.030+0000 7f4c54ff9640 1 -- 172.21.15.116:0/1341929806 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f4c50003ae0 con 0x7f4c58135ec0 2024-01-23T07:33:35.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.030+0000 7f4c54ff9640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f4c3806c920 0x7f4c3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.030+0000 7f32793d2640 1 --2- 172.21.15.116:0/212262167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c0d0270 0x7f326c031f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3270009870 tx=0x7f327002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75d37ca3c7ebb483 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.030+0000 7f4c56ffd640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f4c3806c920 0x7f4c3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.030+0000 7f4c56ffd640 10 monclient: get_auth_request con 0x7f4c3806c920 auth_method 0 2024-01-23T07:33:35.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.030+0000 7f4c54ff9640 10 client.4336.objecter ms_handle_connect 0x7f4c3806c920 2024-01-23T07:33:35.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.030+0000 7f4c56ffd640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f4c3806c920 0x7f4c3806ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c48036000 tx=0x7f4c4803b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.034+0000 7f4c54ff9640 1 -- 172.21.15.116:0/1341929806 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4c50058dd0 con 0x7f4c58135ec0 2024-01-23T07:33:35.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.034+0000 7f4c54ff9640 10 client.4336.objecter ms_dispatch 0x7f4c58000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:35.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.034+0000 7f4c54ff9640 3 client.4336.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:35.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.034+0000 7f4c54ff9640 3 client.4336.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:35.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.034+0000 7f4c54ff9640 20 client.4336.objecter dump_active .. 0 homeless 2024-01-23T07:33:35.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.044+0000 7f4c54ff9640 1 -- 172.21.15.116:0/1341929806 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f4c50054a10 con 0x7f4c58135ec0 2024-01-23T07:33:35.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.044+0000 7f4c54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.044+0000 7f4c54ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:35.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 1 -- 172.21.15.116:0/212262167 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32700317e0 con 0x7f326c0d0270 2024-01-23T07:33:35.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:35.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: dump: 2024-01-23T07:33:35.051 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.051 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 1 -- 172.21.15.116:0/212262167 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270031940 con 0x7f326c0d0270 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 1 -- 172.21.15.116:0/212262167 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270031cd0 con 0x7f326c0d0270 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f3278bd1640 10 monclient: dump: 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f327abd5640 5 monclient: authenticate success, global_id 4339 2024-01-23T07:33:35.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f327abd5640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:35.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f327abd5640 4 set_mon_vals no callback set 2024-01-23T07:33:35.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.051+0000 7f2d1affd640 1 --2- 172.21.15.116:0/4167181684 >> v2:172.21.15.173:3300/0 conn(0x7f2d1c13faa0 0x7f2d1c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 10 monclient: shutdown 2024-01-23T07:33:35.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 1 -- 172.21.15.116:0/212262167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c0d0270 msgr2=0x7f326c031f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 1 --2- 172.21.15.116:0/212262167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c0d0270 0x7f326c031f40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3270009870 tx=0x7f327002b880 comp rx=0 tx=0).stop 2024-01-23T07:33:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f2d1affd640 10 monclient(hunting): get_auth_request con 0x7f2d1c13faa0 auth_method 0 2024-01-23T07:33:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f2d1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f2d1affd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f2d1affd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 1 -- 172.21.15.116:0/212262167 shutdown_connections 2024-01-23T07:33:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 1 --2- 172.21.15.116:0/212262167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c0d0270 0x7f326c031f40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 1 -- 172.21.15.116:0/212262167 >> 172.21.15.116:0/212262167 conn(0x7f326c006060 msgr2=0x7f326c006470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f2d1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f2d1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f2d1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 1 -- 172.21.15.116:0/212262167 shutdown_connections 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f327abd5640 1 -- 172.21.15.116:0/212262167 wait complete. 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f327abd5640 10 monclient: build_initial_monmap 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f327abd5640 10 monclient: monmap: 2024-01-23T07:33:35.057 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.052+0000 7f6dbffff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6dc813faa0 0x7f6dc80b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f6dbffff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f6dc813faa0 0x7f6dc80b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37834/0 (socket says 172.21.15.116:37834) 2024-01-23T07:33:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f6dbffff640 1 -- 172.21.15.116:0/2236868588 learned_addr learned my addr 172.21.15.116:0/2236868588 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f6dbffff640 10 monclient(hunting): get_auth_request con 0x7f6dc813faa0 auth_method 0 2024-01-23T07:33:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f6dbffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f6dbffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f6dbffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f327abd5640 1 librados: starting msgr at 2024-01-23T07:33:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.053+0000 7f327abd5640 1 librados: starting objecter 2024-01-23T07:33:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 Processor -- start 2024-01-23T07:33:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 -- start start 2024-01-23T07:33:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 librados: setting wanted keys 2024-01-23T07:33:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 librados: calling monclient init 2024-01-23T07:33:35.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient: init 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326c007270 0x7f326c0ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): picked mon.noname-a con 0x7f326c007270 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c031390 0x7f326c02eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): picked mon.noname-b con 0x7f326c031390 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f326c0cccc0 0x7f326c164930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): picked mon.noname-c con 0x7f326c0cccc0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0cc830 con 0x7f326c007270 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0cbae0 con 0x7f326c031390 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326c0cbd50 con 0x7f326c0cccc0 2024-01-23T07:33:35.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:35.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.054+0000 7f327abd5640 10 monclient(hunting): authenticate will time out at 2422.412986s 2024-01-23T07:33:35.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.055+0000 7f6dbffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.055+0000 7f6dbffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.055+0000 7f6dbffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 10 monclient(hunting): handle_auth_done global_id 4345 payload 274 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 1 -- 172.21.15.116:0/4167181684 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c145600 msgr2=0x7f2d1c145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 1 --2- 172.21.15.116:0/4167181684 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c145600 0x7f2d1c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 1 -- 172.21.15.116:0/4167181684 >> v1:172.21.15.116:6789/0 conn(0x7f2d1c0a96e0 legacy=0x7f2d1c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 1 monclient: found mon.noname-c 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.056+0000 7f2d1affd640 1 -- 172.21.15.116:0/4167181684 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c0aae80 con 0x7f2d1c13faa0 2024-01-23T07:33:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.057+0000 7fa63288e640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa62c13fb30 0x7fa62c14ca30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42354/0 (socket says 172.21.15.116:42354) 2024-01-23T07:33:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.057+0000 7fa63288e640 1 -- 172.21.15.116:0/934854207 learned_addr learned my addr 172.21.15.116:0/934854207 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 10 monclient(hunting): handle_auth_done global_id 4348 payload 274 2024-01-23T07:33:35.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 1 -- 172.21.15.116:0/2236868588 >> v2:172.21.15.116:3300/0 conn(0x7f6dc8145600 msgr2=0x7f6dc8145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 1 --2- 172.21.15.116:0/2236868588 >> v2:172.21.15.116:3300/0 conn(0x7f6dc8145600 0x7f6dc8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 1 -- 172.21.15.116:0/2236868588 >> v1:172.21.15.116:6789/0 conn(0x7f6dc80a96e0 legacy=0x7f6dc813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 1 monclient: found mon.noname-c 2024-01-23T07:33:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.059+0000 7f6dbffff640 1 -- 172.21.15.116:0/2236868588 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80aae80 con 0x7f6dc813faa0 2024-01-23T07:33:35.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.063+0000 7f2d1affd640 1 --2- 172.21.15.116:0/4167181684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c0b1850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009790 tx=0x7f2d1002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dde9b770be98486 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.066+0000 7f6dbffff640 1 --2- 172.21.15.116:0/2236868588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc813faa0 0x7f6dc80b1850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8072780 tx=0x7f6db002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f0e31657d61fbd1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.071+0000 7f32793d2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c031390 0x7f326c02eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.072+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614209775 0 0) 0x7fa62c0aaad0 con 0x7fa62c13fb30 2024-01-23T07:33:35.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.072+0000 7fa63108b640 10 monclient(hunting): _negotiate 2024-01-23T07:33:35.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.072+0000 7fa63108b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.072+0000 7fa63108b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.072+0000 7fa63108b640 10 monclient(hunting): my global_id is 4351 2024-01-23T07:33:35.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.073+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa618003520 con 0x7fa62c13fb30 2024-01-23T07:33:35.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.073+0000 7f32793d2640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c031390 0x7f326c02eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37844/0 (socket says 172.21.15.116:37844) 2024-01-23T07:33:35.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.073+0000 7f32793d2640 1 -- 172.21.15.116:0/2856680733 learned_addr learned my addr 172.21.15.116:0/2856680733 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:35.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.073+0000 7f32793d2640 10 monclient(hunting): get_auth_request con 0x7f326c031390 auth_method 0 2024-01-23T07:33:35.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.073+0000 7f32793d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.073+0000 7f32793d2640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.073+0000 7f32793d2640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 1 -- 172.21.15.116:0/4167181684 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10031800 con 0x7f2d1c13faa0 2024-01-23T07:33:35.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:35.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: dump: 2024-01-23T07:33:35.075 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.075 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.076 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.076 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.076 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.076 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 1 -- 172.21.15.116:0/4167181684 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d10031960 con 0x7f2d1c13faa0 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d21d49640 5 monclient: authenticate success, global_id 4345 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 1 -- 172.21.15.116:0/4167181684 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d10031cf0 con 0x7f2d1c13faa0 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d21d49640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:35.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d21d49640 4 set_mon_vals no callback set 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.074+0000 7f2d1a7fc640 10 monclient: dump: 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.078 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 1 -- 172.21.15.116:0/2236868588 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0004230 con 0x7f6dc813faa0 2024-01-23T07:33:35.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: dump: 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.080 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 1 -- 172.21.15.116:0/2236868588 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db0004390 con 0x7f6dc813faa0 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 1 -- 172.21.15.116:0/2236868588 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0003810 con 0x7f6dc813faa0 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dcd46e640 5 monclient: authenticate success, global_id 4348 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dcd46e640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dcd46e640 4 set_mon_vals no callback set 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f6dc67fc640 10 monclient: dump: 2024-01-23T07:33:35.081 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.082 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 10 monclient: shutdown 2024-01-23T07:33:35.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 -- 172.21.15.116:0/4167181684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 msgr2=0x7f2d1c0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 --2- 172.21.15.116:0/4167181684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c0b1850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009790 tx=0x7f2d1002b8a0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 -- 172.21.15.116:0/4167181684 shutdown_connections 2024-01-23T07:33:35.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 --2- 172.21.15.116:0/4167181684 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c145600 0x7f2d1c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 --2- 172.21.15.116:0/4167181684 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c0b1850 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 -- 172.21.15.116:0/4167181684 >> 172.21.15.116:0/4167181684 conn(0x7f2d1c0b7bb0 msgr2=0x7f2d1c0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 -- 172.21.15.116:0/4167181684 shutdown_connections 2024-01-23T07:33:35.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.075+0000 7f2d21d49640 1 -- 172.21.15.116:0/4167181684 wait complete. 2024-01-23T07:33:35.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 10 monclient: shutdown 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 -- 172.21.15.116:0/2236868588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc813faa0 msgr2=0x7f6dc80b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/2236868588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc813faa0 0x7f6dc80b1850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8072780 tx=0x7f6db002b8f0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 -- 172.21.15.116:0/2236868588 shutdown_connections 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/2236868588 >> v2:172.21.15.116:3300/0 conn(0x7f6dc8145600 0x7f6dc8145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/2236868588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc813faa0 0x7f6dc80b1850 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 -- 172.21.15.116:0/2236868588 >> 172.21.15.116:0/2236868588 conn(0x7f6dc80b7bb0 msgr2=0x7f6dc80b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f32793d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f32793d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f32793d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 -- 172.21.15.116:0/2236868588 shutdown_connections 2024-01-23T07:33:35.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f6dcd46e640 1 -- 172.21.15.116:0/2236868588 wait complete. 2024-01-23T07:33:35.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f2d21d49640 10 monclient: build_initial_monmap 2024-01-23T07:33:35.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f2d21d49640 10 monclient: monmap: 2024-01-23T07:33:35.087 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:35.087 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f2d21d49640 1 librados: starting msgr at 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f2d21d49640 1 librados: starting objecter 2024-01-23T07:33:35.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.076+0000 7f2d21d49640 1 Processor -- start 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 10 monclient: build_initial_monmap 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 10 monclient: monmap: 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:35.089 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f2d21d49640 1 -- start start 2024-01-23T07:33:35.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f2d21d49640 1 librados: setting wanted keys 2024-01-23T07:33:35.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f2d21d49640 1 librados: calling monclient init 2024-01-23T07:33:35.092 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f2d21d49640 10 monclient: init 2024-01-23T07:33:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 1 librados: starting msgr at 2024-01-23T07:33:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 1 librados: starting objecter 2024-01-23T07:33:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 1 Processor -- start 2024-01-23T07:33:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 1 -- start start 2024-01-23T07:33:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 1 librados: setting wanted keys 2024-01-23T07:33:35.093 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 1 librados: calling monclient init 2024-01-23T07:33:35.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.077+0000 7f6dcd46e640 10 monclient: init 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c0a96e0 0x7f2d1c135300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): picked mon.noname-c con 0x7f2d1c0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c131c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): picked mon.noname-b con 0x7f2d1c13faa0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c145600 0x7f2d1c1321d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): picked mon.noname-a con 0x7f2d1c145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c132710 con 0x7f2d1c145600 2024-01-23T07:33:35.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c134620 con 0x7f2d1c13faa0 2024-01-23T07:33:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c134890 con 0x7f2d1c0a96e0 2024-01-23T07:33:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:35.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f2d21d49640 10 monclient(hunting): authenticate will time out at 2422.436473s 2024-01-23T07:33:35.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:35.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:35.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc80a96e0 0x7f6dc8136b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): picked mon.noname-b con 0x7f6dc80a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:35.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6dc813faa0 0x7f6dc813e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.097 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): picked mon.noname-c con 0x7f6dc813faa0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dc8145600 0x7f6dc8135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): picked mon.noname-a con 0x7f6dc8145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc81388b0 con 0x7f6dc8145600 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8137c30 con 0x7f6dc80a96e0 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc8138580 con 0x7f6dc813faa0 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:35.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.078+0000 7f6dcd46e640 10 monclient(hunting): authenticate will time out at 2422.436806s 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 10 monclient(hunting): handle_auth_done global_id 4354 payload 824 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 1 -- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f326c0cccc0 msgr2=0x7f326c164930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f326c0cccc0 0x7f326c164930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 1 -- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326c007270 msgr2=0x7f326c0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326c007270 0x7f326c0ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 1 monclient: found mon.noname-b 2024-01-23T07:33:35.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.082+0000 7f32793d2640 1 -- 172.21.15.116:0/2856680733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32700094d0 con 0x7f326c031390 2024-01-23T07:33:35.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2599246285 0 0) 0x7fa618003520 con 0x7fa62c13fb30 2024-01-23T07:33:35.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa62c0a96e0 msgr2=0x7fa62c1427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa62c0a96e0 0x7fa62c1427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 >> v1:172.21.15.116:6789/0 conn(0x7fa62c0a9ac0 legacy=0x7fa62c13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 monclient: found mon.noname-c-legacy 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.173:6789/0 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0ab090 con 0x7fa62c13fb30 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4041568432 0 0) 0x7fa6240019f0 con 0x7fa62c13fb30 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: dump: 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.102 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] but i'm connected to v1:172.21.15.173:6789/0, reconnecting 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 >> v1:172.21.15.173:6789/0 conn(0x7fa62c13fb30 legacy=0x7fa62c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa618003970 0x7fa618003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): picked mon.b con 0x7fa618003970 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:35.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa62c0a96e0 0x7fa6180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): picked mon.c con 0x7fa62c0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa618004e20 0x7fa61800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): picked mon.a con 0x7fa618004e20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c0aadb0 con 0x7fa618004e20 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180054a0 con 0x7fa618003970 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa618005660 con 0x7fa62c0a96e0 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:35.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.083+0000 7fa63108b640 10 monclient(hunting): _finish_auth 0 2024-01-23T07:33:35.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.087+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc80a96e0 0x7f6dc8136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.087+0000 7f6dc6ffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc80a96e0 0x7f6dc8136b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37852/0 (socket says 172.21.15.116:37852) 2024-01-23T07:33:35.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.087+0000 7f6dc6ffd640 1 -- 172.21.15.116:0/3934255536 learned_addr learned my addr 172.21.15.116:0/3934255536 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:35.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.087+0000 7f6dc6ffd640 10 monclient(hunting): get_auth_request con 0x7f6dc80a96e0 auth_method 0 2024-01-23T07:33:35.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.087+0000 7f6dc6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.087+0000 7f6dc6ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.105 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.087+0000 7f6dc6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.088+0000 7f32793d2640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c031390 0x7f326c02eb80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3270000c00 tx=0x7f32700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.088+0000 7f326a7fc640 10 client.?.objecter ms_handle_connect 0x7f326c031390 2024-01-23T07:33:35.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.088+0000 7f326a7fc640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:35.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.088+0000 7f6dc6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.088+0000 7f6dc6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.088+0000 7f6dc6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.089+0000 7fa63208d640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa618003970 0x7fa618003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 10 monclient(hunting): handle_auth_done global_id 4357 payload 824 2024-01-23T07:33:35.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 1 -- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6dc813faa0 msgr2=0x7f6dc813e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6dc813faa0 0x7f6dc813e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 1 -- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dc8145600 msgr2=0x7f6dc8135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dc8145600 0x7f6dc8135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 1 monclient: found mon.noname-b 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.092+0000 7f6dc6ffd640 1 -- 172.21.15.116:0/3934255536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009460 con 0x7f6dc80a96e0 2024-01-23T07:33:35.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.093+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c131c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f6dc6ffd640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc80a96e0 0x7f6dc8136b90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6db800c410 tx=0x7f6db800c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f6dbf7fe640 10 client.?.objecter ms_handle_connect 0x7f6dc80a96e0 2024-01-23T07:33:35.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f6dbf7fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:35.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f2d1affd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c131c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37846/0 (socket says 172.21.15.116:37846) 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f2d1affd640 1 -- 172.21.15.116:0/3972631029 learned_addr learned my addr 172.21.15.116:0/3972631029 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f2d1affd640 10 monclient(hunting): get_auth_request con 0x7f2d1c13faa0 auth_method 0 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f2d1affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f2d1affd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7f2d1affd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7fa63208d640 10 monclient(hunting): get_auth_request con 0x7fa618003970 auth_method 0 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7fa63208d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7fa63208d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.097+0000 7fa63208d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:33:35.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.098+0000 7f2d1affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.098+0000 7f2d1affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.098+0000 7f2d1affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 10 monclient(hunting): handle_auth_done global_id 4360 payload 824 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 1 -- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c0a96e0 msgr2=0x7f2d1c135300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c0a96e0 0x7f2d1c135300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 1 -- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c145600 msgr2=0x7f2d1c1321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c145600 0x7f2d1c1321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 1 monclient: found mon.noname-b 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.112 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7f2d1affd640 1 -- 172.21.15.116:0/3972631029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d100093a0 con 0x7f2d1c13faa0 2024-01-23T07:33:35.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7fa63208d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7fa63208d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.101+0000 7fa63208d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T07:33:35.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 1 -- 172.21.15.116:0/3934255536 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db80035f0 con 0x7f6dc80a96e0 2024-01-23T07:33:35.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:35.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: dump: 2024-01-23T07:33:35.114 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.114 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.114 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 1 -- 172.21.15.116:0/3934255536 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db8003750 con 0x7f6dc80a96e0 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 1 -- 172.21.15.116:0/3934255536 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8003b40 con 0x7f6dc80a96e0 2024-01-23T07:33:35.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dbf7fe640 10 monclient: dump: 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.116 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 5 monclient: authenticate success, global_id 4357 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 10 monclient: _renew_subs 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc8138160 con 0x7f6dc80a96e0 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dc5ffb640 4 set_mon_vals no callback set 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 10 client.4357.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 10 monclient: _renew_subs 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc8136500 con 0x7f6dc80a96e0 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.105+0000 7f6dcd46e640 1 librados: init done 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.106+0000 7f6dcd46e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.106+0000 7f6dcd46e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.106+0000 7f6dcd46e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.117 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.106+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc8067d70 con 0x7f6dc80a96e0 2024-01-23T07:33:35.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 10 monclient(hunting): handle_auth_done global_id 4351 payload 293 2024-01-23T07:33:35.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 1 -- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa62c0a96e0 msgr2=0x7fa6180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa62c0a96e0 0x7fa6180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 1 -- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa618004e20 msgr2=0x7fa61800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa618004e20 0x7fa61800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.118 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 1 monclient: found mon.b 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 1 -- 172.21.15.116:0/934854207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618003520 con 0x7fa618003970 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa63208d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa6342f1640 5 monclient: authenticate success, global_id 4351 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.108+0000 7fa6342f1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:35.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.110+0000 7f2d1affd640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c131c90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098b0 tx=0x7f2d100046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.110+0000 7f2d03fff640 10 client.?.objecter ms_handle_connect 0x7f2d1c13faa0 2024-01-23T07:33:35.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.110+0000 7f2d03fff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 1 -- 172.21.15.116:0/2856680733 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270032880 con 0x7f326c031390 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: dump: 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.121 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 1 -- 172.21.15.116:0/2856680733 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270032a00 con 0x7f326c031390 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 5 monclient: authenticate success, global_id 4354 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 10 monclient: _renew_subs 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326c0cc450 con 0x7f326c031390 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 1 -- 172.21.15.116:0/2856680733 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270032db0 con 0x7f326c031390 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326a7fc640 10 monclient: dump: 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f326bfff640 4 set_mon_vals no callback set 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 10 client.4354.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:35.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 10 monclient: _renew_subs 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326c165050 con 0x7f326c031390 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.112+0000 7f327abd5640 1 librados: init done 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.113+0000 7f327abd5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.113+0000 7f327abd5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.113+0000 7f327abd5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.113+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326c0cc640 con 0x7f326c031390 2024-01-23T07:33:35.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.121+0000 7f3b177fe640 1 -- 172.21.15.116:0/3504606795 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3b24054c80 con 0x7f3b30145600 2024-01-23T07:33:35.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.121+0000 7f3b177fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.121+0000 7f3b177fe640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:35.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.126+0000 7f3d495f4640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f3d4413f390 0x7f3d4413f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:48538/0 (socket says 172.21.15.116:48538) 2024-01-23T07:33:35.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.126+0000 7f3d495f4640 1 -- 172.21.15.116:0/2411994803 learned_addr learned my addr 172.21.15.116:0/2411994803 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.129+0000 7f3d49df5640 1 --2- 172.21.15.116:0/2411994803 >> v2:172.21.15.116:3300/0 conn(0x7f3d440a96e0 0x7f3d440b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.130+0000 7f3d49df5640 10 monclient(hunting): get_auth_request con 0x7f3d440a96e0 auth_method 0 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.130+0000 7f3d49df5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.130+0000 7f3d49df5640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.130+0000 7f3d49df5640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.131+0000 7f3d48df3640 1 -- 172.21.15.116:0/2411994803 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260254436 0 0) 0x7f3d440aac10 con 0x7f3d4413f390 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.131+0000 7f3d48df3640 10 monclient(hunting): _negotiate 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.131+0000 7f3d48df3640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.131+0000 7f3d48df3640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.131+0000 7f3d48df3640 10 monclient(hunting): my global_id is 4350 2024-01-23T07:33:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.131+0000 7f3d48df3640 1 -- 172.21.15.116:0/2411994803 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d30003520 con 0x7f3d4413f390 2024-01-23T07:33:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.132+0000 7f3d49df5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.132+0000 7f3d49df5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.132+0000 7f3d49df5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.135+0000 7f3d4a5f6640 1 --2- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d44145600 0x7f3d44145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.137+0000 7f3d4a5f6640 10 monclient(hunting): get_auth_request con 0x7f3d44145600 auth_method 0 2024-01-23T07:33:35.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.137+0000 7f3d4a5f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.137+0000 7f3d4a5f6640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.137+0000 7f3d4a5f6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d4a5f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d4a5f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.139 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d4a5f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 10 monclient(hunting): handle_auth_done global_id 4353 payload 274 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 1 -- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d44145600 msgr2=0x7f3d44145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 1 --2- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d44145600 0x7f3d44145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 1 -- 172.21.15.116:0/2411994803 >> v1:172.21.15.116:6789/0 conn(0x7f3d4413f390 legacy=0x7f3d4413f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 1 monclient: found mon.noname-a 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.140 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.141 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.138+0000 7f3d49df5640 1 -- 172.21.15.116:0/2411994803 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440aae80 con 0x7f3d440a96e0 2024-01-23T07:33:35.143 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.143+0000 7f3d49df5640 1 --2- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440a96e0 0x7f3d440b1850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0097a0 tx=0x7f3d3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383d05c4fb9836ee server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.150+0000 7fb246ffd640 1 -- 172.21.15.116:0/2125081720 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb248058910 con 0x7fb2580b0e40 2024-01-23T07:33:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.150+0000 7fb246ffd640 10 client.14264.objecter ms_dispatch 0x7fb258000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.150+0000 7fb246ffd640 3 client.14264.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.150+0000 7fb246ffd640 3 client.14264.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.151+0000 7fb246ffd640 20 client.14264.objecter dump_active .. 0 homeless 2024-01-23T07:33:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.151+0000 7fb246ffd640 1 -- 172.21.15.116:0/2125081720 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb248054550 con 0x7fb2580b0e40 2024-01-23T07:33:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.151+0000 7fb246ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.151+0000 7fb246ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 1 -- 172.21.15.116:0/2411994803 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c031830 con 0x7f3d440a96e0 2024-01-23T07:33:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: dump: 2024-01-23T07:33:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 1 -- 172.21.15.116:0/2411994803 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3c031990 con 0x7f3d440a96e0 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 1 -- 172.21.15.116:0/2411994803 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c031d20 con 0x7f3d440a96e0 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d48df3640 10 monclient: dump: 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d4c059640 5 monclient: authenticate success, global_id 4353 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d4c059640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.158+0000 7f3d4c059640 4 set_mon_vals no callback set 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 10 monclient: shutdown 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 -- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440a96e0 msgr2=0x7f3d440b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 --2- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440a96e0 0x7f3d440b1850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0097a0 tx=0x7f3d3c02b8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 -- 172.21.15.116:0/2411994803 shutdown_connections 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 --2- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d44145600 0x7f3d44145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 --2- 172.21.15.116:0/2411994803 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d440a96e0 0x7f3d440b1850 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 -- 172.21.15.116:0/2411994803 >> 172.21.15.116:0/2411994803 conn(0x7f3d440b7bb0 msgr2=0x7f3d440b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 -- 172.21.15.116:0/2411994803 shutdown_connections 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.159+0000 7f3d4c059640 1 -- 172.21.15.116:0/2411994803 wait complete. 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.160+0000 7f3d4c059640 10 monclient: build_initial_monmap 2024-01-23T07:33:35.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.160+0000 7f3d4c059640 10 monclient: monmap: 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.160+0000 7f3d4c059640 1 librados: starting msgr at 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.160+0000 7f3d4c059640 1 librados: starting objecter 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.161+0000 7f3d4c059640 1 Processor -- start 2024-01-23T07:33:35.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.161+0000 7f3d4c059640 1 -- start start 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.161+0000 7f3d4c059640 1 librados: setting wanted keys 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.161+0000 7f3d4c059640 1 librados: calling monclient init 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.161+0000 7f3d4c059640 10 monclient: init 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.161+0000 7f3d4c059640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.161+0000 7f3d4c059640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d440a96e0 0x7f3d44134720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): picked mon.noname-b con 0x7f3d440a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d4413f390 0x7f3d441379e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): picked mon.noname-c con 0x7f3d4413f390 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44145600 0x7f3d44137f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): picked mon.noname-a con 0x7f3d44145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44138460 con 0x7f3d44145600 2024-01-23T07:33:35.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441386a0 con 0x7f3d440a96e0 2024-01-23T07:33:35.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44131c00 con 0x7f3d4413f390 2024-01-23T07:33:35.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:35.166 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.162+0000 7f3d4c059640 10 monclient(hunting): authenticate will time out at 2422.520356s 2024-01-23T07:33:35.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.167+0000 7f3d4a5f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44145600 0x7f3d44137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.167+0000 7f3d4a5f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44145600 0x7f3d44137f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54682/0 (socket says 172.21.15.116:54682) 2024-01-23T07:33:35.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.167+0000 7f3d4a5f6640 1 -- 172.21.15.116:0/1546035249 learned_addr learned my addr 172.21.15.116:0/1546035249 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:35.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.167+0000 7f3d4a5f6640 10 monclient(hunting): get_auth_request con 0x7f3d44145600 auth_method 0 2024-01-23T07:33:35.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.167+0000 7f3d4a5f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.167+0000 7f3d4a5f6640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.167+0000 7f3d4a5f6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d4a5f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d4a5f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d4a5f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d495f4640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d4413f390 0x7f3d441379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d495f4640 10 monclient(hunting): get_auth_request con 0x7f3d4413f390 auth_method 0 2024-01-23T07:33:35.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d495f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d495f4640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.169+0000 7f3d495f4640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.171+0000 7f3d495f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.171+0000 7f3d495f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.171+0000 7f3d495f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 10 monclient(hunting): handle_auth_done global_id 4356 payload 824 2024-01-23T07:33:35.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 1 -- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d4413f390 msgr2=0x7f3d441379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d4413f390 0x7f3d441379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 1 -- 172.21.15.116:0/1546035249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d440a96e0 msgr2=0x7f3d44134720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d440a96e0 0x7f3d44134720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 1 monclient: found mon.noname-a 2024-01-23T07:33:35.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.172+0000 7f3d4a5f6640 1 -- 172.21.15.116:0/1546035249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c009400 con 0x7f3d44145600 2024-01-23T07:33:35.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.175+0000 7f3d4a5f6640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44145600 0x7f3d44137f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000ec10 tx=0x7f3d4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.175+0000 7f3d3a7fc640 10 client.?.objecter ms_handle_connect 0x7f3d44145600 2024-01-23T07:33:35.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.175+0000 7f3d3a7fc640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:35.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 1 -- 172.21.15.116:0/1546035249 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000cd20 con 0x7f3d44145600 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: dump: 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.181 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 1 -- 172.21.15.116:0/1546035249 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000f040 con 0x7f3d44145600 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 1 -- 172.21.15.116:0/1546035249 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d400146c0 con 0x7f3d44145600 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3a7fc640 10 monclient: dump: 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.182 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 5 monclient: authenticate success, global_id 4356 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 10 monclient: _renew_subs 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d44131e20 con 0x7f3d44145600 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d3bfff640 4 set_mon_vals no callback set 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 10 client.4356.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 10 monclient: _renew_subs 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d441322e0 con 0x7f3d44145600 2024-01-23T07:33:35.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.180+0000 7f3d4c059640 1 librados: init done 2024-01-23T07:33:35.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.181+0000 7f3d4c059640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.181+0000 7f3d4c059640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.181+0000 7f3d4c059640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.181+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d44067d70 con 0x7f3d44145600 2024-01-23T07:33:35.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.219+0000 7f3d3a7fc640 1 -- 172.21.15.116:0/1546035249 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f3d40014a30 con 0x7f3d44145600 2024-01-23T07:33:35.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.219+0000 7f3d3a7fc640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3d2806c8b0 0x7f3d2806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.219+0000 7f3d49df5640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3d2806c8b0 0x7f3d2806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.219+0000 7f3d49df5640 10 monclient: get_auth_request con 0x7f3d2806c8b0 auth_method 0 2024-01-23T07:33:35.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.220+0000 7f3d3a7fc640 10 client.4356.objecter ms_handle_connect 0x7f3d2806c8b0 2024-01-23T07:33:35.220 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.220+0000 7f3d49df5640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3d2806c8b0 0x7f3d2806ed70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c036000 tx=0x7f3d3c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.222+0000 7f3d3a7fc640 1 -- 172.21.15.116:0/1546035249 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3d4000ce80 con 0x7f3d44145600 2024-01-23T07:33:35.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.222+0000 7f3d3a7fc640 10 client.4356.objecter ms_dispatch 0x7f3d44000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:35.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.222+0000 7f3d3a7fc640 3 client.4356.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:35.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.222+0000 7f3d3a7fc640 3 client.4356.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:35.222 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.222+0000 7f3d3a7fc640 20 client.4356.objecter dump_active .. 0 homeless 2024-01-23T07:33:35.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.300+0000 7f4c57fff640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.300+0000 7f4c57fff640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.300+0000 7f4c57fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.300+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4c58135230 con 0x7f4c58135ec0 2024-01-23T07:33:35.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.316+0000 7f3b157fa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:35.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.316+0000 7f3b157fa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:35.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.316+0000 7f3b157fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.316+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3b08005600 con 0x7f3b30145600 2024-01-23T07:33:35.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.358+0000 7f6dbf7fe640 1 -- 172.21.15.116:0/3934255536 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6db8003ca0 con 0x7f6dc80a96e0 2024-01-23T07:33:35.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.358+0000 7f6dbf7fe640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6da806c8b0 0x7f6da806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.358+0000 7f6dbffff640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6da806c8b0 0x7f6da806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.358+0000 7f6dbffff640 10 monclient: get_auth_request con 0x7f6da806c8b0 auth_method 0 2024-01-23T07:33:35.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.359+0000 7f6dbf7fe640 10 client.4357.objecter ms_handle_connect 0x7f6da806c8b0 2024-01-23T07:33:35.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.359+0000 7f6dbffff640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6da806c8b0 0x7f6da806ed70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6db0035000 tx=0x7f6db0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7f6dbf7fe640 1 -- 172.21.15.116:0/3934255536 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6db8058440 con 0x7f6dc80a96e0 2024-01-23T07:33:35.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7f6dbf7fe640 10 client.4357.objecter ms_dispatch 0x7f6dc8000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:35.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7f6dbf7fe640 3 client.4357.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:35.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7f6dbf7fe640 3 client.4357.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:35.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7f6dbf7fe640 20 client.4357.objecter dump_active .. 0 homeless 2024-01-23T07:33:35.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7fb25cbea640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:35.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7fb25cbea640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:35.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7fb25cbea640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:35.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.360+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb23c005600 con 0x7fb2580b0e40 2024-01-23T07:33:35.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.364+0000 7fb246ffd640 1 -- 172.21.15.116:0/2125081720 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb248015020 con 0x7fb2580b0e40 2024-01-23T07:33:35.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.364+0000 7fb246ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:35.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.364+0000 7fb246ffd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:35.364 INFO:teuthology.orchestra.run.smithi116.stdout:64424509447 2024-01-23T07:33:35.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 10 librados: watch_flush enter 2024-01-23T07:33:35.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 10 librados: watch_flush exit 2024-01-23T07:33:35.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 20 client.14264.objecter shutdown clearing up homeless session... 2024-01-23T07:33:35.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 10 client.14264.objecter successfully canceled tick 2024-01-23T07:33:35.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb23806c860 msgr2=0x7fb23806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb23806c860 0x7fb23806ed20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb24c03a000 tx=0x7fb24c032000 comp rx=0 tx=0).stop 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 10 monclient: shutdown 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2580b0e40 msgr2=0x7fb258138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2580b0e40 0x7fb258138bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb24800b410 tx=0x7fb24800b8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 shutdown_connections 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb23806c860 0x7fb23806ed20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb2581422d0 0x7fb2581dec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb25813b600 0x7fb258139100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 --2- 172.21.15.116:0/2125081720 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb2580b0e40 0x7fb258138bc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 >> 172.21.15.116:0/2125081720 conn(0x7fb2580b0320 msgr2=0x7fb25813c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 shutdown_connections 2024-01-23T07:33:35.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 -- 172.21.15.116:0/2125081720 wait complete. 2024-01-23T07:33:35.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.366+0000 7fb25cbea640 1 librados: shutdown 2024-01-23T07:33:35.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.369+0000 7f6dbf7fe640 1 -- 172.21.15.116:0/3934255536 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6db8054080 con 0x7f6dc80a96e0 2024-01-23T07:33:35.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.369+0000 7f6dbf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.369+0000 7f6dbf7fe640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:35.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-01-23T07:33:35.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.484+0000 7f3d3a7fc640 1 -- 172.21.15.116:0/1546035249 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3d40055860 con 0x7f3d44145600 2024-01-23T07:33:35.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.484+0000 7f3d3a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.484+0000 7f3d3a7fc640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:35.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.491+0000 7f3b177fe640 1 -- 172.21.15.116:0/3504606795 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b24015020 con 0x7f3b30145600 2024-01-23T07:33:35.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.491+0000 7f3b177fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:35.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.491+0000 7f3b177fe640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:35.491 INFO:teuthology.orchestra.run.smithi116.stdout:68719476741 2024-01-23T07:33:35.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.492+0000 7f3b157fa640 10 librados: watch_flush enter 2024-01-23T07:33:35.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.492+0000 7f3b157fa640 10 librados: watch_flush exit 2024-01-23T07:33:35.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.492+0000 7f3b157fa640 20 client.4344.objecter shutdown clearing up homeless session... 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.492+0000 7f3b157fa640 10 client.4344.objecter successfully canceled tick 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3b1c06c8b0 msgr2=0x7f3b1c06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3b1c06c8b0 0x7f3b1c06ed70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b20036000 tx=0x7f3b20030000 comp rx=0 tx=0).stop 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 10 monclient: shutdown 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b30145600 msgr2=0x7f3b30136050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b30145600 0x7f3b30136050 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400b3e0 tx=0x7f3b2400b8a0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 shutdown_connections 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3b1c06c8b0 0x7f3b1c06ed70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3b30145600 0x7f3b30136050 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3b3013f390 0x7f3b30138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 --2- 172.21.15.116:0/3504606795 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b300a96e0 0x7f3b300b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 >> 172.21.15.116:0/3504606795 conn(0x7f3b300b7bb0 msgr2=0x7f3b301355a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 shutdown_connections 2024-01-23T07:33:35.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 -- 172.21.15.116:0/3504606795 wait complete. 2024-01-23T07:33:35.495 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.493+0000 7f3b157fa640 1 librados: shutdown 2024-01-23T07:33:35.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.2 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.544+0000 7f2d03fff640 1 -- 172.21.15.116:0/3972631029 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1003bc30 con 0x7f2d1c13faa0 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 10 monclient: dump: 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.546 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 1 -- 172.21.15.116:0/3972631029 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1003bd90 con 0x7f2d1c13faa0 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 5 monclient: authenticate success, global_id 4360 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d03fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 10 monclient: _renew_subs 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c134b70 con 0x7f2d1c13faa0 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d19ffb640 4 set_mon_vals no callback set 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 10 client.4360.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 10 monclient: _renew_subs 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c1361b0 con 0x7f2d1c13faa0 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.545+0000 7f2d21d49640 1 librados: init done 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.546+0000 7f2d21d49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.546+0000 7f2d21d49640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.546+0000 7f2d21d49640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.546+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c067d70 con 0x7f2d1c13faa0 2024-01-23T07:33:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.585+0000 7f6dcd46e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-01-23T07:33:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.585+0000 7f6dcd46e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-01-23T07:33:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.585+0000 7f6dcd46e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.585+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6dc804ea10 con 0x7f6dc80a96e0 2024-01-23T07:33:35.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.605+0000 7f2d03fff640 1 -- 172.21.15.116:0/3972631029 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1004e5f0 con 0x7f2d1c13faa0 2024-01-23T07:33:35.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.605+0000 7f2d03fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.605 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.605+0000 7f2d03fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.605+0000 7f2d03fff640 10 monclient: dump: 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.606 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.628+0000 7f326a7fc640 1 -- 172.21.15.116:0/2856680733 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f327004d3f0 con 0x7f326c031390 2024-01-23T07:33:35.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.628+0000 7f326a7fc640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f325806c8b0 0x7f325806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.629+0000 7f3279bd3640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f325806c8b0 0x7f325806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.629+0000 7f3279bd3640 10 monclient: get_auth_request con 0x7f325806c8b0 auth_method 0 2024-01-23T07:33:35.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.629+0000 7f3279bd3640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f325806c8b0 0x7f325806ed70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32740641a0 tx=0x7f3274066320 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.629+0000 7f326a7fc640 10 client.4354.objecter ms_handle_connect 0x7f325806c8b0 2024-01-23T07:33:35.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.638+0000 7f326a7fc640 1 -- 172.21.15.116:0/2856680733 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f327007aaa0 con 0x7f326c031390 2024-01-23T07:33:35.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.638+0000 7f326a7fc640 10 client.4354.objecter ms_dispatch 0x7f3274000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:35.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.638+0000 7f326a7fc640 3 client.4354.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:35.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.638+0000 7f326a7fc640 3 client.4354.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:35.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.638+0000 7f326a7fc640 20 client.4354.objecter dump_active .. 0 homeless 2024-01-23T07:33:35.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.648+0000 7f326a7fc640 1 -- 172.21.15.116:0/2856680733 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f32700766e0 con 0x7f326c031390 2024-01-23T07:33:35.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.648+0000 7f326a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.648+0000 7f326a7fc640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:35.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.686+0000 7f3d4c059640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:35.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.686+0000 7f3d4c059640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:35.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.686+0000 7f3d4c059640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.686+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3d4404ea10 con 0x7f3d44145600 2024-01-23T07:33:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.689+0000 7f3d3a7fc640 1 -- 172.21.15.116:0/1546035249 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d40018070 con 0x7f3d44145600 2024-01-23T07:33:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.689+0000 7f3d3a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:35.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.689+0000 7f3d3a7fc640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:35.722 INFO:teuthology.orchestra.run.smithi116.stdout:60129542149 2024-01-23T07:33:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 10 librados: watch_flush enter 2024-01-23T07:33:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 10 librados: watch_flush exit 2024-01-23T07:33:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 20 client.4356.objecter shutdown clearing up homeless session... 2024-01-23T07:33:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 10 client.4356.objecter successfully canceled tick 2024-01-23T07:33:35.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3d2806c8b0 msgr2=0x7f3d2806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3d2806c8b0 0x7f3d2806ed70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c036000 tx=0x7f3d3c030000 comp rx=0 tx=0).stop 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 10 monclient: shutdown 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44145600 msgr2=0x7f3d44137f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44145600 0x7f3d44137f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d4000ec10 tx=0x7f3d4000c490 comp rx=0 tx=0).stop 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 shutdown_connections 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f3d2806c8b0 0x7f3d2806ed70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d44145600 0x7f3d44137f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3d4413f390 0x7f3d441379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 --2- 172.21.15.116:0/1546035249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d440a96e0 0x7f3d44134720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.691+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 >> 172.21.15.116:0/1546035249 conn(0x7f3d440b7bb0 msgr2=0x7f3d440b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.692+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 shutdown_connections 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.692+0000 7f3d4c059640 1 -- 172.21.15.116:0/1546035249 wait complete. 2024-01-23T07:33:35.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.692+0000 7f3d4c059640 1 librados: shutdown 2024-01-23T07:33:35.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.0 2024-01-23T07:33:35.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.828+0000 7f327abd5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:35.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.828+0000 7f327abd5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:35.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.828+0000 7f327abd5640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:35.828 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.828+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f326c0cc640 con 0x7f326c031390 2024-01-23T07:33:35.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.885+0000 7f4c54ff9640 1 -- 172.21.15.116:0/1341929806 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c50058030 con 0x7f4c58135ec0 2024-01-23T07:33:35.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.886+0000 7f4c54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:35.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.886+0000 7f4c54ff9640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:35.886 INFO:teuthology.orchestra.run.smithi116.stdout:77309411335 2024-01-23T07:33:35.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.887+0000 7f4c57fff640 10 librados: watch_flush enter 2024-01-23T07:33:35.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.887+0000 7f4c57fff640 10 librados: watch_flush exit 2024-01-23T07:33:35.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.887+0000 7f4c57fff640 20 client.4336.objecter shutdown clearing up homeless session... 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.887+0000 7f4c57fff640 10 client.4336.objecter successfully canceled tick 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f4c3806c920 msgr2=0x7f4c3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f4c3806c920 0x7f4c3806ede0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4c48036000 tx=0x7f4c4803b040 comp rx=0 tx=0).stop 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 10 monclient: shutdown 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c58135ec0 msgr2=0x7f4c581dab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c58135ec0 0x7f4c581dab70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000c730 tx=0x7f4c5000cb30 comp rx=0 tx=0).stop 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 shutdown_connections 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f4c3806c920 0x7f4c3806ede0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c58135ec0 0x7f4c581dab70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f4c5813f1b0 0x7f4c581358d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 --2- 172.21.15.116:0/1341929806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4c580b37b0 0x7f4c5813e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 >> 172.21.15.116:0/1341929806 conn(0x7f4c580b7a40 msgr2=0x7f4c580b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 shutdown_connections 2024-01-23T07:33:35.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 -- 172.21.15.116:0/1341929806 wait complete. 2024-01-23T07:33:35.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.888+0000 7f4c57fff640 1 librados: shutdown 2024-01-23T07:33:35.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.898+0000 7f2d03fff640 1 -- 172.21.15.116:0/3972631029 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2d100453f0 con 0x7f2d1c13faa0 2024-01-23T07:33:35.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.899+0000 7f2d03fff640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2d0806c8b0 0x7f2d0806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.899+0000 7f2d1b7fe640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2d0806c8b0 0x7f2d0806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.899 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.899+0000 7f2d1b7fe640 10 monclient: get_auth_request con 0x7f2d0806c8b0 auth_method 0 2024-01-23T07:33:35.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.899+0000 7f2d03fff640 10 client.4360.objecter ms_handle_connect 0x7f2d0806c8b0 2024-01-23T07:33:35.900 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.899+0000 7f2d1b7fe640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2d0806c8b0 0x7f2d0806ed70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c001610 tx=0x7f2d0c007930 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411337 got 77309411335 for osd.4 2024-01-23T07:33:35.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.902+0000 7f2d03fff640 1 -- 172.21.15.116:0/3972631029 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2d1002e070 con 0x7f2d1c13faa0 2024-01-23T07:33:35.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.902+0000 7f2d03fff640 10 client.4360.objecter ms_dispatch 0x7f2d1c000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:35.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.902+0000 7f2d03fff640 3 client.4360.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:35.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.902+0000 7f2d03fff640 3 client.4360.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:35.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.902+0000 7f2d03fff640 20 client.4360.objecter dump_active .. 0 homeless 2024-01-23T07:33:35.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.914+0000 7f2d03fff640 1 -- 172.21.15.116:0/3972631029 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2d10077150 con 0x7f2d1c13faa0 2024-01-23T07:33:35.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.914+0000 7f2d03fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:35.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.914+0000 7f2d03fff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:35.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.914+0000 7f326a7fc640 1 -- 172.21.15.116:0/2856680733 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3270079d00 con 0x7f326c031390 2024-01-23T07:33:35.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.914+0000 7f326a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:35.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.914+0000 7f326a7fc640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:35.915 INFO:teuthology.orchestra.run.smithi116.stdout:55834574852 2024-01-23T07:33:35.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.916+0000 7f6dbf7fe640 1 -- 172.21.15.116:0/3934255536 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6db8017090 con 0x7f6dc80a96e0 2024-01-23T07:33:35.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.916+0000 7f6dbf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-01-23T07:33:35.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.916+0000 7f6dbf7fe640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:35.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.916+0000 7f327abd5640 10 librados: watch_flush enter 2024-01-23T07:33:35.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.916+0000 7f327abd5640 10 librados: watch_flush exit 2024-01-23T07:33:35.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.916+0000 7f327abd5640 20 client.4354.objecter shutdown clearing up homeless session... 2024-01-23T07:33:35.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.916+0000 7f327abd5640 10 client.4354.objecter successfully canceled tick 2024-01-23T07:33:35.918 INFO:teuthology.orchestra.run.smithi116.stdout:81604378632 2024-01-23T07:33:35.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f325806c8b0 msgr2=0x7f325806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f325806c8b0 0x7f325806ed70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f32740641a0 tx=0x7f3274066320 comp rx=0 tx=0).stop 2024-01-23T07:33:35.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 10 monclient: shutdown 2024-01-23T07:33:35.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c031390 msgr2=0x7f326c02eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c031390 0x7f326c02eb80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3270000c00 tx=0x7f32700046c0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 shutdown_connections 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f325806c8b0 0x7f325806ed70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f326c0cccc0 0x7f326c164930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f326c031390 0x7f326c02eb80 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3270000c00 tx=0x7f32700046c0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 --2- 172.21.15.116:0/2856680733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f326c007270 0x7f326c0ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 >> 172.21.15.116:0/2856680733 conn(0x7f326c006060 msgr2=0x7f326c037f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 shutdown_connections 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 -- 172.21.15.116:0/2856680733 wait complete. 2024-01-23T07:33:35.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.917+0000 7f327abd5640 1 librados: shutdown 2024-01-23T07:33:35.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 10 librados: watch_flush enter 2024-01-23T07:33:35.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 10 librados: watch_flush exit 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 20 client.4357.objecter shutdown clearing up homeless session... 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 10 client.4357.objecter successfully canceled tick 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6da806c8b0 msgr2=0x7f6da806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6da806c8b0 0x7f6da806ed70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6db0035000 tx=0x7f6db0030000 comp rx=0 tx=0).stop 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 10 monclient: shutdown 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc80a96e0 msgr2=0x7f6dc8136b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc80a96e0 0x7f6dc8136b90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6db800c410 tx=0x7f6db800c8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 shutdown_connections 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6da806c8b0 0x7f6da806ed70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dc8145600 0x7f6dc8135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6dc813faa0 0x7f6dc813e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 --2- 172.21.15.116:0/3934255536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6dc80a96e0 0x7f6dc8136b90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 >> 172.21.15.116:0/3934255536 conn(0x7f6dc80b7bb0 msgr2=0x7f6dc80b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 shutdown_connections 2024-01-23T07:33:35.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 -- 172.21.15.116:0/3934255536 wait complete. 2024-01-23T07:33:35.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.919+0000 7f6dcd46e640 1 librados: shutdown 2024-01-23T07:33:35.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.925+0000 7fa63208d640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa618003970 0x7fa618003d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa628009860 tx=0x7fa6180057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14975ccb686653e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2024-01-23T07:33:35.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 81604378633 got 81604378632 for osd.1 2024-01-23T07:33:35.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628032600 con 0x7fa618003970 2024-01-23T07:33:35.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 10 monclient: dump: 2024-01-23T07:33:35.972 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62802e050 con 0x7fa618003970 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa6342f1640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 1 -- 172.21.15.116:0/934854207 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628032a00 con 0x7fa618003970 2024-01-23T07:33:35.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa6342f1640 4 set_mon_vals no callback set 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63108b640 10 monclient: dump: 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.974 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa6342f1640 10 monclient: shutdown 2024-01-23T07:33:35.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa6342f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa6342f1640 1 -- 172.21.15.116:0/934854207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa618003970 msgr2=0x7fa618003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa6342f1640 1 --2- 172.21.15.116:0/934854207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa618003970 0x7fa618003d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa628009860 tx=0x7fa6180057f0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.972+0000 7fa63288e640 1 -- 172.21.15.116:0/934854207 reap_dead start 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 1 -- 172.21.15.116:0/934854207 shutdown_connections 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 1 -- 172.21.15.116:0/934854207 >> 172.21.15.116:0/934854207 conn(0x7fa62c0b7bb0 msgr2=0x7fa62c0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 1 -- 172.21.15.116:0/934854207 shutdown_connections 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 1 -- 172.21.15.116:0/934854207 wait complete. 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 10 monclient: build_initial_monmap 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 10 monclient: monmap: 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:35.978 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 1 librados: starting msgr at 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.973+0000 7fa6342f1640 1 librados: starting objecter 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 Processor -- start 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 -- start start 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 librados: setting wanted keys 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 librados: calling monclient init 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient: init 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:35.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa618003970 0x7fa62c143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): picked mon.noname-c con 0x7fa618003970 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa62c144980 0x7fa62c135db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): picked mon.noname-a con 0x7fa62c144980 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa62c1362f0 0x7fa62c1d7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): picked mon.noname-b con 0x7fa62c1362f0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c145c00 con 0x7fa62c144980 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c144e00 con 0x7fa62c1362f0 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c1367a0 con 0x7fa618003970 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:35.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.974+0000 7fa6342f1640 10 monclient(hunting): authenticate will time out at 2423.332824s 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63188c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa62c144980 0x7fa62c135db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63208d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa618003970 0x7fa62c143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63208d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa618003970 0x7fa62c143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36400/0 (socket says 172.21.15.116:36400) 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63208d640 1 -- 172.21.15.116:0/2043411136 learned_addr learned my addr 172.21.15.116:0/2043411136 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63208d640 10 monclient(hunting): get_auth_request con 0x7fa618003970 auth_method 0 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63208d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63208d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63208d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63188c640 10 monclient(hunting): get_auth_request con 0x7fa62c144980 auth_method 0 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63188c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63188c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.975+0000 7fa63188c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.976+0000 7fa63208d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.976+0000 7fa63208d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.976+0000 7fa63208d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.976+0000 7fa63188c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:35.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.976+0000 7fa63188c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:35.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.976+0000 7fa63188c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:35.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 10 monclient(hunting): handle_auth_done global_id 4359 payload 824 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 1 -- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa618003970 msgr2=0x7fa62c143d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa618003970 0x7fa62c143d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 1 -- 172.21.15.116:0/2043411136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa62c1362f0 msgr2=0x7fa62c1d7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa62c1362f0 0x7fa62c1d7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 1 monclient: found mon.noname-a 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63188c640 1 -- 172.21.15.116:0/2043411136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c145e50 con 0x7fa62c144980 2024-01-23T07:33:35.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.979+0000 7fa63208d640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa618003970 0x7fa62c143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T07:33:35.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.983+0000 7fa63188c640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa62c144980 0x7fa62c135db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c410 tx=0x7fa61c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:35.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.983+0000 7fa622ffd640 10 client.?.objecter ms_handle_connect 0x7fa62c144980 2024-01-23T07:33:35.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.984+0000 7fa622ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:35.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 1 -- 172.21.15.116:0/2043411136 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c0035f0 con 0x7fa62c144980 2024-01-23T07:33:35.996 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: dump: 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:35.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 1 -- 172.21.15.116:0/2043411136 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c003750 con 0x7fa62c144980 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 1 -- 172.21.15.116:0/2043411136 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c003b00 con 0x7fa62c144980 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 5 monclient: authenticate success, global_id 4359 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa622ffd640 10 monclient: dump: 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:35.998 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa63088a640 4 set_mon_vals no callback set 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 10 monclient: _renew_subs 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c146130 con 0x7fa62c144980 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 10 monclient: _renew_subs 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c1d7b40 con 0x7fa62c144980 2024-01-23T07:33:35.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.996+0000 7fa6342f1640 1 librados: init done 2024-01-23T07:33:36.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.997+0000 7fa6342f1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.997+0000 7fa6342f1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.997+0000 7fa6342f1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:36.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:35.997+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c067d70 con 0x7fa62c144980 2024-01-23T07:33:36.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.102+0000 7f2d21d49640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:36.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.102+0000 7f2d21d49640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:36.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.102+0000 7f2d21d49640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.102+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2d1c068420 con 0x7f2d1c13faa0 2024-01-23T07:33:36.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.106+0000 7f2d03fff640 1 -- 172.21.15.116:0/3972631029 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2d10035020 con 0x7f2d1c13faa0 2024-01-23T07:33:36.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.106+0000 7f2d03fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:36.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.106+0000 7f2d03fff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:36.107 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-01-23T07:33:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.108+0000 7f2d21d49640 10 librados: watch_flush enter 2024-01-23T07:33:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.108+0000 7f2d21d49640 10 librados: watch_flush exit 2024-01-23T07:33:36.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.108+0000 7f2d21d49640 20 client.4360.objecter shutdown clearing up homeless session... 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.108+0000 7f2d21d49640 10 client.4360.objecter successfully canceled tick 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2d0806c8b0 msgr2=0x7f2d0806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2d0806c8b0 0x7f2d0806ed70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c001610 tx=0x7f2d0c007930 comp rx=0 tx=0).stop 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 10 monclient: shutdown 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 msgr2=0x7f2d1c131c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c131c90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098b0 tx=0x7f2d100046c0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 shutdown_connections 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2d0806c8b0 0x7f2d0806ed70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d1c145600 0x7f2d1c1321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d1c13faa0 0x7f2d1c131c90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 --2- 172.21.15.116:0/3972631029 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2d1c0a96e0 0x7f2d1c135300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 >> 172.21.15.116:0/3972631029 conn(0x7f2d1c0b7bb0 msgr2=0x7f2d1c13ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:36.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 shutdown_connections 2024-01-23T07:33:36.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 -- 172.21.15.116:0/3972631029 wait complete. 2024-01-23T07:33:36.111 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.109+0000 7f2d21d49640 1 librados: shutdown 2024-01-23T07:33:36.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-01-23T07:33:36.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.293+0000 7fa622ffd640 1 -- 172.21.15.116:0/2043411136 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa61c003c60 con 0x7fa62c144980 2024-01-23T07:33:36.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.293+0000 7fa622ffd640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa61006c8e0 0x7fa61006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.293+0000 7fa63208d640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa61006c8e0 0x7fa61006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.293+0000 7fa63208d640 10 monclient: get_auth_request con 0x7fa61006c8e0 auth_method 0 2024-01-23T07:33:36.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.294+0000 7fa622ffd640 10 client.4359.objecter ms_handle_connect 0x7fa61006c8e0 2024-01-23T07:33:36.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.294+0000 7fa63208d640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa61006c8e0 0x7fa61006eda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa628009860 tx=0x7fa628008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 1 -- 172.21.15.116:0/2043411136 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa61c057bb0 con 0x7fa62c144980 2024-01-23T07:33:36.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 10 client.4359.objecter ms_dispatch 0x7fa62c000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:36.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 3 client.4359.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:36.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 3 client.4359.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:36.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 20 client.4359.objecter dump_active .. 0 homeless 2024-01-23T07:33:36.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 1 -- 172.21.15.116:0/2043411136 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa61c053ef0 con 0x7fa62c144980 2024-01-23T07:33:36.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.306+0000 7fa622ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:36.378 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-23T07:33:36.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.485+0000 7f8d2d078640 10 monclient: get_monmap_and_config 2024-01-23T07:33:36.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.485+0000 7f8d2d078640 10 monclient: build_initial_monmap 2024-01-23T07:33:36.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.485+0000 7f8d2d078640 10 monclient: monmap: 2024-01-23T07:33:36.485 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:36.485 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:36.486481+0000 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:36.486481+0000 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:36.486 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.485+0000 7f8d2d078640 1 Processor -- start 2024-01-23T07:33:36.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.485+0000 7f8d2d078640 1 -- start start 2024-01-23T07:33:36.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.485+0000 7f8d2d078640 10 monclient: init 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8d280a96e0 0x7f8d280b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient(hunting): picked mon.noname-a con 0x7f8d280a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d2813f390 0x7f8d2813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient(hunting): picked mon.noname-c con 0x7f8d2813f390 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f8d28145600 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d280aac10 con 0x7f8d28145600 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d280a9e00 con 0x7f8d280a96e0 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2813fd30 con 0x7f8d2813f390 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:36.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.486+0000 7f8d2d078640 10 monclient(hunting): authenticate will time out at 2423.844758s 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d26d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8d280a96e0 0x7f8d280b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d2659c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d2813f390 0x7f8d2813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d26d9d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f8d280a96e0 0x7f8d280b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:48930/0 (socket says 172.21.15.116:48930) 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d2659c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f8d2813f390 0x7f8d2813f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37858/0 (socket says 172.21.15.116:37858) 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d26d9d640 1 -- 172.21.15.116:0/1527250836 learned_addr learned my addr 172.21.15.116:0/1527250836 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d26d9d640 10 monclient(hunting): get_auth_request con 0x7f8d280a96e0 auth_method 0 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d26d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d26d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d26d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d2659c640 10 monclient(hunting): get_auth_request con 0x7f8d2813f390 auth_method 0 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d2659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d2659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.487+0000 7f8d2659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.488+0000 7f8d2659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.488+0000 7f8d2659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.488+0000 7f8d2659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.488+0000 7f8d26d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.488+0000 7f8d26d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.488+0000 7f8d26d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 10 monclient(hunting): handle_auth_done global_id 4363 payload 274 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 1 -- 172.21.15.116:0/1527250836 >> v2:172.21.15.116:3300/0 conn(0x7f8d280a96e0 msgr2=0x7f8d280b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 1 --2- 172.21.15.116:0/1527250836 >> v2:172.21.15.116:3300/0 conn(0x7f8d280a96e0 0x7f8d280b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 1 -- 172.21.15.116:0/1527250836 >> v1:172.21.15.116:6789/0 conn(0x7f8d28145600 legacy=0x7f8d28145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 1 monclient: found mon.noname-c 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.489+0000 7f8d2659c640 1 -- 172.21.15.116:0/1527250836 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d280a9ac0 con 0x7f8d2813f390 2024-01-23T07:33:36.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.491+0000 7f8d2659c640 1 --2- 172.21.15.116:0/1527250836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d2813f390 0x7f8d2813f7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d28072780 tx=0x7f8d1c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85fe518ddf415063 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.491+0000 7fa6342f1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-01-23T07:33:36.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.491+0000 7fa6342f1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-01-23T07:33:36.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.491+0000 7fa6342f1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:36.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.491+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa62c04ea10 con 0x7fa62c144980 2024-01-23T07:33:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 1 -- 172.21.15.116:0/1527250836 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c031830 con 0x7f8d2813f390 2024-01-23T07:33:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: dump: 2024-01-23T07:33:36.496 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: _finish_auth 0 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: _check_auth_tickets 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 1 -- 172.21.15.116:0/1527250836 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1c031990 con 0x7f8d2813f390 2024-01-23T07:33:36.497 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d2d078640 5 monclient: authenticate success, global_id 4363 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d2d078640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d2d078640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 1 -- 172.21.15.116:0/1527250836 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c031d20 con 0x7f8d2813f390 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d2d078640 4 set_mon_vals no callback set 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.495+0000 7f8d25d9b640 10 monclient: dump: 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.498 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 10 monclient: shutdown 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 -- 172.21.15.116:0/1527250836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d2813f390 msgr2=0x7f8d2813f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1527250836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d2813f390 0x7f8d2813f7f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d28072780 tx=0x7f8d1c02b8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 -- 172.21.15.116:0/1527250836 shutdown_connections 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1527250836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d2813f390 0x7f8d2813f7f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1527250836 >> v2:172.21.15.116:3300/0 conn(0x7f8d280a96e0 0x7f8d280b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 -- 172.21.15.116:0/1527250836 >> 172.21.15.116:0/1527250836 conn(0x7f8d280b7bb0 msgr2=0x7f8d280b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 -- 172.21.15.116:0/1527250836 shutdown_connections 2024-01-23T07:33:36.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.496+0000 7f8d2d078640 1 -- 172.21.15.116:0/1527250836 wait complete. 2024-01-23T07:33:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 10 monclient: build_initial_monmap 2024-01-23T07:33:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 10 monclient: monmap: 2024-01-23T07:33:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:36.501 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 1 librados: starting msgr at 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 1 librados: starting objecter 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 1 Processor -- start 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 1 -- start start 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 1 librados: setting wanted keys 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 1 librados: calling monclient init 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.497+0000 7f8d2d078640 10 monclient: init 2024-01-23T07:33:36.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d280a96e0 0x7f8d28132c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): picked mon.noname-b con 0x7f8d280a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8d2813f390 0x7f8d28133240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): picked mon.noname-c con 0x7f8d2813f390 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d28145600 0x7f8d28131d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): picked mon.noname-a con 0x7f8d28145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d281358a0 con 0x7f8d28145600 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d28133d80 con 0x7f8d280a96e0 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d28133ef0 con 0x7f8d2813f390 2024-01-23T07:33:36.503 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d2d078640 10 monclient(hunting): authenticate will time out at 2423.856557s 2024-01-23T07:33:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.498+0000 7f8d26d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d280a96e0 0x7f8d28132c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7fa622ffd640 1 -- 172.21.15.116:0/2043411136 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa61c017020 con 0x7fa62c144980 2024-01-23T07:33:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7fa622ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-01-23T07:33:36.504 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7fa622ffd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:36.504 INFO:teuthology.orchestra.run.smithi116.stdout:81604378634 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d280a96e0 0x7f8d28132c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37872/0 (socket says 172.21.15.116:37872) 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 1 -- 172.21.15.116:0/1448121279 learned_addr learned my addr 172.21.15.116:0/1448121279 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 10 monclient(hunting): get_auth_request con 0x7f8d280a96e0 auth_method 0 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d2659c640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8d2813f390 0x7f8d28133240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d2659c640 10 monclient(hunting): get_auth_request con 0x7f8d2813f390 auth_method 0 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d2659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d2659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d2659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.499+0000 7f8d26d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.500+0000 7f8d2659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.500+0000 7f8d2659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.500+0000 7f8d2659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.507 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-23T07:33:36.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 10 librados: watch_flush enter 2024-01-23T07:33:36.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 10 librados: watch_flush exit 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 20 client.4359.objecter shutdown clearing up homeless session... 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 10 client.4359.objecter successfully canceled tick 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa61006c8e0 msgr2=0x7fa61006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa61006c8e0 0x7fa61006eda0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa628009860 tx=0x7fa628008030 comp rx=0 tx=0).stop 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 10 monclient: shutdown 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa62c144980 msgr2=0x7fa62c135db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa62c144980 0x7fa62c135db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa61c00c410 tx=0x7fa61c00c8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 shutdown_connections 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa61006c8e0 0x7fa61006eda0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa62c1362f0 0x7fa62c1d7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa62c144980 0x7fa62c135db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 --2- 172.21.15.116:0/2043411136 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa618003970 0x7fa62c143d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 >> 172.21.15.116:0/2043411136 conn(0x7fa62c0b7bb0 msgr2=0x7fa62c0b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:36.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 shutdown_connections 2024-01-23T07:33:36.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 -- 172.21.15.116:0/2043411136 wait complete. 2024-01-23T07:33:36.510 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.501+0000 7fa6342f1640 1 librados: shutdown 2024-01-23T07:33:36.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 10 monclient(hunting): handle_auth_done global_id 4366 payload 824 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 1 -- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8d2813f390 msgr2=0x7f8d28133240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8d2813f390 0x7f8d28133240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 1 -- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d28145600 msgr2=0x7f8d28131d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d28145600 0x7f8d28131d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 10 monclient: _finish_hunting 0 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 1 monclient: found mon.noname-b 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.502+0000 7f8d26d9d640 1 -- 172.21.15.116:0/1448121279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c0093a0 con 0x7f8d280a96e0 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.504+0000 7f8d26d9d640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d280a96e0 0x7f8d28132c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e8e0 tx=0x7f8d1800eda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.504+0000 7f8d0f7fe640 10 client.?.objecter ms_handle_connect 0x7f8d280a96e0 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.504+0000 7f8d0f7fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:36.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 1 -- 172.21.15.116:0/1448121279 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800c940 con 0x7f8d280a96e0 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: dump: 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.513 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 1 -- 172.21.15.116:0/1448121279 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1800caa0 con 0x7f8d280a96e0 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 1 -- 172.21.15.116:0/1448121279 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800ce50 con 0x7f8d280a96e0 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d0f7fe640 10 monclient: dump: 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.514 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 5 monclient: authenticate success, global_id 4366 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 10 monclient: _renew_subs 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d28146320 con 0x7f8d280a96e0 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2559a640 4 set_mon_vals no callback set 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:36.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 10 monclient: _renew_subs 2024-01-23T07:33:36.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d281322d0 con 0x7f8d280a96e0 2024-01-23T07:33:36.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.508+0000 7f8d2d078640 1 librados: init done 2024-01-23T07:33:36.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.509+0000 7f8d2d078640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.509+0000 7f8d2d078640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.509+0000 7f8d2d078640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.509+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d28067d70 con 0x7f8d280a96e0 2024-01-23T07:33:36.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 81604378635 got 81604378634 for osd.3 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.610+0000 7fdb5d4df640 10 monclient: get_monmap_and_config 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.610+0000 7fdb5d4df640 10 monclient: build_initial_monmap 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.610+0000 7fdb5d4df640 10 monclient: monmap: 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:36.612059+0000 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:36.612059+0000 2024-01-23T07:33:36.611 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:36.612 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.612 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:36.612 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:36.612 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:36.612 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:36.612 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:36.612 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.611+0000 7fdb5d4df640 1 Processor -- start 2024-01-23T07:33:36.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.611+0000 7fdb5d4df640 1 -- start start 2024-01-23T07:33:36.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.611+0000 7fdb5d4df640 10 monclient: init 2024-01-23T07:33:36.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:36.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient: _add_conns ranks=[2,0,4,1,3] 2024-01-23T07:33:36.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb580b4890 0x7fdb5813f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.614 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient(hunting): picked mon.noname-b con 0x7fdb580b4890 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdb580b1ff0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fdb58145c00 0x7fdb5813f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient(hunting): picked mon.noname-c con 0x7fdb58145c00 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580a9d70 con 0x7fdb580b1ff0 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb580b4c70 con 0x7fdb58145c00 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580ab0f0 con 0x7fdb580b4890 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb5d4df640 10 monclient(hunting): authenticate will time out at 2423.970338s 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb56ffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb580b4890 0x7fdb5813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb567fc640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fdb580b1ff0 0x7fdb581454f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37364/0 (socket says 172.21.15.116:37364) 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb567fc640 1 -- 172.21.15.116:0/2373207997 learned_addr learned my addr 172.21.15.116:0/2373207997 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:36.615 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb56ffd640 10 monclient(hunting): get_auth_request con 0x7fdb580b4890 auth_method 0 2024-01-23T07:33:36.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb56ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb56ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.612+0000 7fdb56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.613+0000 7fdb56ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.613+0000 7fdb56ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.616 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.613+0000 7fdb56ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 10 monclient(hunting): handle_auth_done global_id 14279 payload 274 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 1 -- 172.21.15.116:0/2373207997 >> v2:172.21.15.173:3300/0 conn(0x7fdb58145c00 msgr2=0x7fdb5813f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 1 --2- 172.21.15.116:0/2373207997 >> v2:172.21.15.173:3300/0 conn(0x7fdb58145c00 0x7fdb5813f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 1 -- 172.21.15.116:0/2373207997 >> v1:172.21.15.116:6789/0 conn(0x7fdb580b1ff0 legacy=0x7fdb581454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 1 monclient: found mon.noname-b 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.615+0000 7fdb56ffd640 1 -- 172.21.15.116:0/2373207997 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580a9920 con 0x7fdb580b4890 2024-01-23T07:33:36.617 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.616+0000 7fdb56ffd640 1 --2- 172.21.15.116:0/2373207997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb580b4890 0x7fdb5813f000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009d90 tx=0x7fdb5002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e67cf88e970b64 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 1 -- 172.21.15.116:0/2373207997 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5002cbc0 con 0x7fdb580b4890 2024-01-23T07:33:36.620 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: dump: 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: _finish_auth 0 2024-01-23T07:33:36.621 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 1 -- 172.21.15.116:0/2373207997 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5002cd20 con 0x7fdb580b4890 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 1 -- 172.21.15.116:0/2373207997 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50034660 con 0x7fdb580b4890 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb55ffb640 10 monclient: dump: 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.622 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.623 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.623 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb5d4df640 5 monclient: authenticate success, global_id 14279 2024-01-23T07:33:36.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb5d4df640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:36.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.620+0000 7fdb5d4df640 4 set_mon_vals no callback set 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 10 monclient: shutdown 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 -- 172.21.15.116:0/2373207997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb580b4890 msgr2=0x7fdb5813f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/2373207997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb580b4890 0x7fdb5813f000 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdb50009d90 tx=0x7fdb5002be10 comp rx=0 tx=0).stop 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 -- 172.21.15.116:0/2373207997 shutdown_connections 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/2373207997 >> v2:172.21.15.173:3300/0 conn(0x7fdb58145c00 0x7fdb5813f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/2373207997 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb580b4890 0x7fdb5813f000 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 -- 172.21.15.116:0/2373207997 >> 172.21.15.116:0/2373207997 conn(0x7fdb58066450 msgr2=0x7fdb58066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 -- 172.21.15.116:0/2373207997 shutdown_connections 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.621+0000 7fdb5d4df640 1 -- 172.21.15.116:0/2373207997 wait complete. 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 10 monclient: build_initial_monmap 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 10 monclient: monmap: 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:36.627 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 1 librados: starting msgr at 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 1 librados: starting objecter 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 1 Processor -- start 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 1 -- start start 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 1 librados: setting wanted keys 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 1 librados: calling monclient init 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.622+0000 7fdb5d4df640 10 monclient: init 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb580b1ff0 0x7fdb58142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): picked mon.noname-b con 0x7fdb580b1ff0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:36.628 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb580b4890 0x7fdb58141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): picked mon.noname-a con 0x7fdb580b4890 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb58145c00 0x7fdb5813d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): picked mon.noname-c con 0x7fdb58145c00 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581388a0 con 0x7fdb580b4890 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58138b80 con 0x7fdb580b1ff0 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58139490 con 0x7fdb58145c00 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb5d4df640 10 monclient(hunting): authenticate will time out at 2423.981381s 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb577fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb58145c00 0x7fdb5813d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb567fc640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb580b4890 0x7fdb58141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb577fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb58145c00 0x7fdb5813d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36420/0 (socket says 172.21.15.116:36420) 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb577fe640 1 -- 172.21.15.116:0/3549707210 learned_addr learned my addr 172.21.15.116:0/3549707210 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb577fe640 10 monclient(hunting): get_auth_request con 0x7fdb58145c00 auth_method 0 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb577fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.623+0000 7fdb577fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb567fc640 10 monclient(hunting): get_auth_request con 0x7fdb580b4890 auth_method 0 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb567fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb567fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb567fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb567fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb567fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.624+0000 7fdb567fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 10 monclient(hunting): handle_auth_done global_id 14282 payload 824 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 1 -- 172.21.15.116:0/3549707210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb580b1ff0 msgr2=0x7fdb58142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb580b1ff0 0x7fdb58142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 1 -- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb580b4890 msgr2=0x7fdb58141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb580b4890 0x7fdb58141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 1 monclient: found mon.noname-c 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.628+0000 7fdb577fe640 1 -- 172.21.15.116:0/3549707210 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009a70 con 0x7fdb58145c00 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.631+0000 7fdb577fe640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb58145c00 0x7fdb5813d4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800b410 tx=0x7fdb4800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.631+0000 7fdb3f7fe640 10 client.?.objecter ms_handle_connect 0x7fdb58145c00 2024-01-23T07:33:36.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.631+0000 7fdb3f7fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:36.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 1 -- 172.21.15.116:0/3549707210 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48011830 con 0x7fdb58145c00 2024-01-23T07:33:36.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 10 monclient: dump: 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:36.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb3f7fe640 1 -- 172.21.15.116:0/3549707210 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb480119b0 con 0x7fdb58145c00 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb5d4df640 5 monclient: authenticate success, global_id 14282 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb5d4df640 10 monclient: _renew_subs 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.634+0000 7fdb5d4df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb580b43f0 con 0x7fdb58145c00 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb3f7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb3f7fe640 1 -- 172.21.15.116:0/3549707210 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48011d60 con 0x7fdb58145c00 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb3f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb3f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb3f7fe640 10 monclient: dump: 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.637 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb557fa640 4 set_mon_vals no callback set 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb5d4df640 10 client.14282.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb5d4df640 10 monclient: _renew_subs 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb5d4df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb580aa170 con 0x7fdb58145c00 2024-01-23T07:33:36.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.635+0000 7fdb5d4df640 1 librados: init done 2024-01-23T07:33:36.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.636+0000 7fdb5d4df640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.636+0000 7fdb5d4df640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.636+0000 7fdb5d4df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:36.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.636+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb581396b0 con 0x7fdb58145c00 2024-01-23T07:33:36.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.654+0000 7fdb3f7fe640 1 -- 172.21.15.116:0/3549707210 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fdb4801a400 con 0x7fdb58145c00 2024-01-23T07:33:36.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.655+0000 7fdb3f7fe640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb4406c8b0 0x7fdb4406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.655+0000 7fdb56ffd640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb4406c8b0 0x7fdb4406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.655+0000 7fdb56ffd640 10 monclient: get_auth_request con 0x7fdb4406c8b0 auth_method 0 2024-01-23T07:33:36.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.655+0000 7fdb3f7fe640 10 client.14282.objecter ms_handle_connect 0x7fdb4406c8b0 2024-01-23T07:33:36.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.655+0000 7fdb56ffd640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb4406c8b0 0x7fdb4406ed70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb50036000 tx=0x7fdb5002e000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.726 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-23T07:33:36.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.753+0000 7f8d0f7fe640 1 -- 172.21.15.116:0/1448121279 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f8d18013470 con 0x7f8d280a96e0 2024-01-23T07:33:36.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.753+0000 7f8d0f7fe640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f8d1406c8b0 0x7f8d1406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.753+0000 7f8d2659c640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f8d1406c8b0 0x7f8d1406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.753+0000 7f8d2659c640 10 monclient: get_auth_request con 0x7f8d1406c8b0 auth_method 0 2024-01-23T07:33:36.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.754+0000 7f8d0f7fe640 10 client.4366.objecter ms_handle_connect 0x7f8d1406c8b0 2024-01-23T07:33:36.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.754+0000 7f8d2659c640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f8d1406c8b0 0x7f8d1406ed70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c036000 tx=0x7f8d1c03d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.755+0000 7f8d0f7fe640 1 -- 172.21.15.116:0/1448121279 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8d18058bf0 con 0x7f8d280a96e0 2024-01-23T07:33:36.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.755+0000 7f8d0f7fe640 10 client.4366.objecter ms_dispatch 0x7f8d28000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:36.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.755+0000 7f8d0f7fe640 3 client.4366.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:36.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.755+0000 7f8d0f7fe640 3 client.4366.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:36.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.755+0000 7f8d0f7fe640 20 client.4366.objecter dump_active .. 0 homeless 2024-01-23T07:33:36.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.765+0000 7f8d0f7fe640 1 -- 172.21.15.116:0/1448121279 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f8d18054f30 con 0x7f8d280a96e0 2024-01-23T07:33:36.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.765+0000 7f8d0f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.765+0000 7f8d0f7fe640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.864+0000 7f2a5b5b1640 10 monclient: get_monmap_and_config 2024-01-23T07:33:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.864+0000 7f2a5b5b1640 10 monclient: build_initial_monmap 2024-01-23T07:33:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.864+0000 7f2a5b5b1640 10 monclient: monmap: 2024-01-23T07:33:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:36.865243+0000 2024-01-23T07:33:36.864 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:36.865243+0000 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:36.865 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.864+0000 7f2a5b5b1640 1 Processor -- start 2024-01-23T07:33:36.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.864+0000 7f2a5b5b1640 1 -- start start 2024-01-23T07:33:36.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.864+0000 7f2a5b5b1640 10 monclient: init 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient: _add_conns ranks=[3,1,4,0,2] 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2a540a96e0 0x7f2a541427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient(hunting): picked mon.noname-a con 0x7f2a540a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f2a540a9ac0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2a5413fb30 0x7f2a5414ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient(hunting): picked mon.noname-c con 0x7f2a5413fb30 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a540aa880 con 0x7f2a540a9ac0 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540aaad0 con 0x7f2a540a96e0 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540aadb0 con 0x7f2a5413fb30 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.865+0000 7f2a5b5b1640 10 monclient(hunting): authenticate will time out at 2424.223732s 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a5934d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2a540a96e0 0x7f2a541427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a59b4e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2a5413fb30 0x7f2a5414ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a59b4e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2a5413fb30 0x7f2a5414ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37892/0 (socket says 172.21.15.116:37892) 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a59b4e640 1 -- 172.21.15.116:0/115654342 learned_addr learned my addr 172.21.15.116:0/115654342 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a59b4e640 10 monclient(hunting): get_auth_request con 0x7f2a5413fb30 auth_method 0 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a59b4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a59b4e640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a59b4e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a5934d640 10 monclient(hunting): get_auth_request con 0x7f2a540a96e0 auth_method 0 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a5934d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a5934d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.866+0000 7f2a5934d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.867+0000 7f2a59b4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.867+0000 7f2a59b4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.867+0000 7f2a59b4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.867+0000 7f2a5934d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.867+0000 7f2a5934d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.867+0000 7f2a5934d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 10 monclient(hunting): handle_auth_done global_id 4369 payload 274 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 1 -- 172.21.15.116:0/115654342 >> v2:172.21.15.116:3300/0 conn(0x7f2a540a96e0 msgr2=0x7f2a541427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 1 --2- 172.21.15.116:0/115654342 >> v2:172.21.15.116:3300/0 conn(0x7f2a540a96e0 0x7f2a541427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 1 -- 172.21.15.116:0/115654342 >> v1:172.21.15.173:6789/0 conn(0x7f2a540a9ac0 legacy=0x7f2a5413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 10 monclient: _finish_hunting 0 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 1 monclient: found mon.noname-c 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.868+0000 7f2a59b4e640 1 -- 172.21.15.116:0/115654342 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540ab090 con 0x7f2a5413fb30 2024-01-23T07:33:36.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.871+0000 7f2a59b4e640 1 --2- 172.21.15.116:0/115654342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a5413fb30 0x7f2a5414ca30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a54146740 tx=0x7f2a4c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a6aa40834c5274d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 1 -- 172.21.15.116:0/115654342 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c02ca80 con 0x7f2a5413fb30 2024-01-23T07:33:36.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:36.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: dump: 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: _finish_auth 0 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:36.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 1 -- 172.21.15.116:0/115654342 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c02cbe0 con 0x7f2a5413fb30 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 1 -- 172.21.15.116:0/115654342 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c0343f0 con 0x7f2a5413fb30 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a5b5b1640 5 monclient: authenticate success, global_id 4369 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a5b5b1640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a5b5b1640 4 set_mon_vals no callback set 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.877+0000 7f2a4bfff640 10 monclient: dump: 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.880 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 10 monclient: shutdown 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/115654342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a5413fb30 msgr2=0x7f2a5414ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/115654342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a5413fb30 0x7f2a5414ca30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a54146740 tx=0x7f2a4c02bee0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/115654342 shutdown_connections 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/115654342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a5413fb30 0x7f2a5414ca30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/115654342 >> v2:172.21.15.116:3300/0 conn(0x7f2a540a96e0 0x7f2a541427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/115654342 >> 172.21.15.116:0/115654342 conn(0x7f2a540b7bb0 msgr2=0x7f2a540b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/115654342 shutdown_connections 2024-01-23T07:33:36.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.878+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/115654342 wait complete. 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.879+0000 7f2a5b5b1640 10 monclient: build_initial_monmap 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.879+0000 7f2a5b5b1640 10 monclient: monmap: 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.884 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.879+0000 7f2a5b5b1640 1 librados: starting msgr at 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.879+0000 7f2a5b5b1640 1 librados: starting objecter 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.880+0000 7f2a5b5b1640 1 Processor -- start 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.880+0000 7f2a5b5b1640 1 -- start start 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.880+0000 7f2a5b5b1640 1 librados: setting wanted keys 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.880+0000 7f2a5b5b1640 1 librados: calling monclient init 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.880+0000 7f2a5b5b1640 10 monclient: init 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:36.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2a540a96e0 0x7f2a54143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): picked mon.noname-c con 0x7f2a540a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a540a9ac0 0x7f2a5413be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): picked mon.noname-b con 0x7f2a540a9ac0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a54145200 0x7f2a541456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): picked mon.noname-a con 0x7f2a54145200 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5413c700 con 0x7f2a54145200 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5413c3c0 con 0x7f2a540a9ac0 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a541447b0 con 0x7f2a540a96e0 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a5b5b1640 10 monclient(hunting): authenticate will time out at 2424.239308s 2024-01-23T07:33:36.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a59b4e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a54145200 0x7f2a541456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.881+0000 7f2a58b4c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a540a9ac0 0x7f2a5413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a540a9ac0 0x7f2a5413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37906/0 (socket says 172.21.15.116:37906) 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 1 -- 172.21.15.116:0/2230174700 learned_addr learned my addr 172.21.15.116:0/2230174700 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 10 monclient(hunting): get_auth_request con 0x7f2a540a9ac0 auth_method 0 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a59b4e640 10 monclient(hunting): get_auth_request con 0x7f2a54145200 auth_method 0 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a59b4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a59b4e640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a59b4e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a58b4c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a59b4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:36.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a59b4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:36.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.882+0000 7f2a59b4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 10 monclient(hunting): handle_auth_done global_id 4372 payload 824 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 1 -- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2a540a96e0 msgr2=0x7f2a54143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2a540a96e0 0x7f2a54143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 1 -- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a54145200 msgr2=0x7f2a541456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a54145200 0x7f2a541456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 1 monclient: found mon.noname-b 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.885+0000 7f2a58b4c640 1 -- 172.21.15.116:0/2230174700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c009b30 con 0x7f2a540a9ac0 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.887+0000 7f2a58b4c640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a540a9ac0 0x7f2a5413be80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c3f0 tx=0x7f2a4400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.887+0000 7f2a49ffb640 10 client.?.objecter ms_handle_connect 0x7f2a540a9ac0 2024-01-23T07:33:36.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.887+0000 7f2a49ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:36.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 1 -- 172.21.15.116:0/2230174700 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44011790 con 0x7f2a540a9ac0 2024-01-23T07:33:36.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:36.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: dump: 2024-01-23T07:33:36.891 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.891 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.891 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: _finish_auth 0 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: _check_auth_tickets 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 5 monclient: authenticate success, global_id 4372 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 1 -- 172.21.15.116:0/2230174700 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44011910 con 0x7f2a540a9ac0 2024-01-23T07:33:36.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:36.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 1 -- 172.21.15.116:0/2230174700 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44011cc0 con 0x7f2a540a9ac0 2024-01-23T07:33:36.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:36.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a4b7fe640 4 set_mon_vals no callback set 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a49ffb640 10 monclient: dump: 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:36.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 10 monclient: _renew_subs 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a54144a90 con 0x7f2a540a9ac0 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 10 client.4372.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 10 monclient: _renew_subs 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a54145dd0 con 0x7f2a540a9ac0 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.891+0000 7f2a5b5b1640 1 librados: init done 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.892+0000 7f2a5b5b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.892+0000 7f2a5b5b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.892+0000 7f2a5b5b1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:36.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.892+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a54067d70 con 0x7f2a540a9ac0 2024-01-23T07:33:36.902 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-23T07:33:36.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 1 -- 172.21.15.116:0/3549707210 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fdb48058f30 con 0x7fdb58145c00 2024-01-23T07:33:36.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 10 client.14282.objecter ms_dispatch 0x7fdb58000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:36.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 3 client.14282.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:36.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 3 client.14282.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:36.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 20 client.14282.objecter dump_active .. 0 homeless 2024-01-23T07:33:36.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 1 -- 172.21.15.116:0/3549707210 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fdb48054b70 con 0x7fdb58145c00 2024-01-23T07:33:36.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:36.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.908+0000 7fdb3f7fe640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:36.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.910+0000 7f2a49ffb640 1 -- 172.21.15.116:0/2230174700 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2a44025430 con 0x7f2a540a9ac0 2024-01-23T07:33:36.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.910+0000 7f2a49ffb640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2a3806c8e0 0x7f2a3806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:36.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.910+0000 7f2a5934d640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2a3806c8e0 0x7f2a3806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:36.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.910+0000 7f2a5934d640 10 monclient: get_auth_request con 0x7f2a3806c8e0 auth_method 0 2024-01-23T07:33:36.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.911+0000 7f2a49ffb640 10 client.4372.objecter ms_handle_connect 0x7f2a3806c8e0 2024-01-23T07:33:36.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:36.911+0000 7f2a5934d640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2a3806c8e0 0x7f2a3806eda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a50006a90 tx=0x7f2a50006a20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:36.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-23T07:33:36.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-23T07:33:37.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f8d2d078640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:37.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f8d2d078640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:37.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f8d2d078640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8d28135130 con 0x7f8d280a96e0 2024-01-23T07:33:37.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f373bbbf640 10 monclient: get_monmap_and_config 2024-01-23T07:33:37.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f373bbbf640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f373bbbf640 10 monclient: monmap: 2024-01-23T07:33:37.015 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.015 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:37.012430+0000 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:37.012430+0000 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.011+0000 7f373bbbf640 1 Processor -- start 2024-01-23T07:33:37.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 1 -- start start 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 10 monclient: init 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 10 monclient: _add_conns ranks=[3,0,2,1,4] 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f37340a96e0 0x7f37340b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 10 monclient(hunting): picked mon.noname-a con 0x7f37340a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f373413f390 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3734145600 0x7f3734145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 10 monclient(hunting): picked mon.noname-b con 0x7f3734145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37340aac10 con 0x7f373413f390 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.012+0000 7f373bbbf640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37340a9e00 con 0x7f37340a96e0 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373bbbf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373bbbf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37340a9ac0 con 0x7f3734145600 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373bbbf640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373bbbf640 10 monclient(hunting): authenticate will time out at 2424.371446s 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373a15c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3734145600 0x7f3734145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373995b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f37340a96e0 0x7f37340b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373995b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f37340a96e0 0x7f37340b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:48970/0 (socket says 172.21.15.116:48970) 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373a15c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3734145600 0x7f3734145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36428/0 (socket says 172.21.15.116:36428) 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373a15c640 1 -- 172.21.15.116:0/3836964586 learned_addr learned my addr 172.21.15.116:0/3836964586 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.013+0000 7f373a15c640 10 monclient(hunting): get_auth_request con 0x7f3734145600 auth_method 0 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373a15c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373a15c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373a15c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373995b640 10 monclient(hunting): get_auth_request con 0x7f37340a96e0 auth_method 0 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373995b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373995b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373995b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373a15c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373a15c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373a15c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373995b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373995b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.014+0000 7f373995b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 10 monclient(hunting): handle_auth_done global_id 14285 payload 274 2024-01-23T07:33:37.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 1 -- 172.21.15.116:0/3836964586 >> v2:172.21.15.116:3300/0 conn(0x7f37340a96e0 msgr2=0x7f37340b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 1 --2- 172.21.15.116:0/3836964586 >> v2:172.21.15.116:3300/0 conn(0x7f37340a96e0 0x7f37340b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.020 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 1 -- 172.21.15.116:0/3836964586 >> v1:172.21.15.116:6789/0 conn(0x7f373413f390 legacy=0x7f373413f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 1 monclient: found mon.noname-b 2024-01-23T07:33:37.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.016+0000 7f373a15c640 1 -- 172.21.15.116:0/3836964586 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340aae80 con 0x7f3734145600 2024-01-23T07:33:37.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.018+0000 7f373a15c640 1 --2- 172.21.15.116:0/3836964586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3734145600 0x7f3734145a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3730009e50 tx=0x7f373002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20fdc4d46514066b server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.021+0000 7f3738959640 1 -- 172.21.15.116:0/3836964586 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373002ca80 con 0x7f3734145600 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.021+0000 7f3738959640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: dump: 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.022 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 1 -- 172.21.15.116:0/3836964586 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373002cbe0 con 0x7f3734145600 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 1 -- 172.21.15.116:0/3836964586 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300343f0 con 0x7f3734145600 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f3738959640 10 monclient: dump: 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 5 monclient: authenticate success, global_id 14285 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:37.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 4 set_mon_vals no callback set 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 10 monclient: shutdown 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 1 -- 172.21.15.116:0/3836964586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3734145600 msgr2=0x7f3734145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 1 --2- 172.21.15.116:0/3836964586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3734145600 0x7f3734145a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3730009e50 tx=0x7f373002bee0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 1 -- 172.21.15.116:0/3836964586 shutdown_connections 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 1 --2- 172.21.15.116:0/3836964586 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f3734145600 0x7f3734145a90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 1 --2- 172.21.15.116:0/3836964586 >> v2:172.21.15.116:3300/0 conn(0x7f37340a96e0 0x7f37340b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.022+0000 7f373bbbf640 1 -- 172.21.15.116:0/3836964586 >> 172.21.15.116:0/3836964586 conn(0x7f37340b7bb0 msgr2=0x7f37340b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.023+0000 7f373bbbf640 1 -- 172.21.15.116:0/3836964586 shutdown_connections 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.023+0000 7f373bbbf640 1 -- 172.21.15.116:0/3836964586 wait complete. 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.023+0000 7f373bbbf640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.023+0000 7f373bbbf640 10 monclient: monmap: 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 librados: starting msgr at 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 librados: starting objecter 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 Processor -- start 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 -- start start 2024-01-23T07:33:37.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 librados: setting wanted keys 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 librados: calling monclient init 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient: init 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37340a96e0 0x7f373413fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): picked mon.noname-c con 0x7f37340a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f373413f390 0x7f37340b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): picked mon.noname-a con 0x7f373413f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3734145600 0x7f3734138050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): picked mon.noname-b con 0x7f3734145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734140db0 con 0x7f373413f390 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37341dabb0 con 0x7f3734145600 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3734140fb0 con 0x7f37340a96e0 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.024+0000 7f373bbbf640 10 monclient(hunting): authenticate will time out at 2424.382994s 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373995b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37340a96e0 0x7f373413fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373915a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f373413f390 0x7f37340b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373995b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37340a96e0 0x7f373413fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36436/0 (socket says 172.21.15.116:36436) 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373995b640 1 -- 172.21.15.116:0/4174286739 learned_addr learned my addr 172.21.15.116:0/4174286739 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373995b640 10 monclient(hunting): get_auth_request con 0x7f37340a96e0 auth_method 0 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373995b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373995b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.025+0000 7f373995b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373915a640 10 monclient(hunting): get_auth_request con 0x7f373413f390 auth_method 0 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373915a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373915a640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373915a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373995b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373995b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373995b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373915a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373915a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.026+0000 7f373915a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 10 monclient(hunting): handle_auth_done global_id 14288 payload 824 2024-01-23T07:33:37.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 1 -- 172.21.15.116:0/4174286739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3734145600 msgr2=0x7f3734138050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3734145600 0x7f3734138050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 1 -- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f373413f390 msgr2=0x7f37340b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f373413f390 0x7f37340b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 1 monclient: found mon.noname-c 2024-01-23T07:33:37.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.029+0000 7f373995b640 1 -- 172.21.15.116:0/4174286739 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730009b30 con 0x7f37340a96e0 2024-01-23T07:33:37.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.032+0000 7f373995b640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37340a96e0 0x7f373413fee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f372c00e9b0 tx=0x7f372c00ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.032+0000 7f372a7fc640 10 client.?.objecter ms_handle_connect 0x7f37340a96e0 2024-01-23T07:33:37.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.032+0000 7f372a7fc640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:37.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 1 -- 172.21.15.116:0/4174286739 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c009670 con 0x7f37340a96e0 2024-01-23T07:33:37.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:37.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 10 monclient: dump: 2024-01-23T07:33:37.038 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.038 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.038 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 1 -- 172.21.15.116:0/4174286739 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c00c9a0 con 0x7f37340a96e0 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f373bbbf640 5 monclient: authenticate success, global_id 14288 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f373bbbf640 10 monclient: _renew_subs 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f373bbbf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37341412f0 con 0x7f37340a96e0 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372a7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f372bfff640 4 set_mon_vals no callback set 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.037+0000 7f373bbbf640 10 client.14288.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f373bbbf640 10 monclient: _renew_subs 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f372a7fc640 1 -- 172.21.15.116:0/4174286739 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c00cd50 con 0x7f37340a96e0 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f373bbbf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3734138590 con 0x7f37340a96e0 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f373bbbf640 1 librados: init done 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f372a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f372a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.038+0000 7f372a7fc640 10 monclient: dump: 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.040 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.039+0000 7f373bbbf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.039+0000 7f373bbbf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.039+0000 7f373bbbf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.039+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3734067d70 con 0x7f37340a96e0 2024-01-23T07:33:37.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.048+0000 7f45271bf640 10 monclient: get_monmap_and_config 2024-01-23T07:33:37.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.048+0000 7f45271bf640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.048+0000 7f45271bf640 10 monclient: monmap: 2024-01-23T07:33:37.048 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.048 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:37.049590+0000 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:37.049590+0000 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:37.049 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 1 Processor -- start 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 1 -- start start 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 10 monclient: init 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 10 monclient: _add_conns ranks=[3,4,1,0,2] 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f45200a96e0 0x7f45200b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 10 monclient(hunting): picked mon.noname-a con 0x7f45200a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f452013f390 0x7f452013f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 10 monclient(hunting): picked mon.noname-c con 0x7f452013f390 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:37.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f4520145600 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45200aac10 con 0x7f4520145600 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.049+0000 7f45271bf640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45200a9e00 con 0x7f45200a96e0 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.050+0000 7f45271bf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.050+0000 7f45271bf640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452013fd30 con 0x7f452013f390 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.050+0000 7f45271bf640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.050+0000 7f45271bf640 10 monclient(hunting): authenticate will time out at 2424.408542s 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.050+0000 7f4524f5b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f45200a96e0 0x7f45200b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f45200a96e0 0x7f45200b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:48996/0 (socket says 172.21.15.116:48996) 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 1 -- 172.21.15.116:0/2389549948 learned_addr learned my addr 172.21.15.116:0/2389549948 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 10 monclient(hunting): get_auth_request con 0x7f45200a96e0 auth_method 0 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.051+0000 7f4524f5b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 10 monclient(hunting): handle_auth_done global_id 4383 payload 274 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 1 -- 172.21.15.116:0/2389549948 >> v2:172.21.15.173:3300/0 conn(0x7f452013f390 msgr2=0x7f452013f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 1 --2- 172.21.15.116:0/2389549948 >> v2:172.21.15.173:3300/0 conn(0x7f452013f390 0x7f452013f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 1 -- 172.21.15.116:0/2389549948 >> v1:172.21.15.173:6789/0 conn(0x7f4520145600 legacy=0x7f4520145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 1 monclient: found mon.noname-a 2024-01-23T07:33:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.053+0000 7f4524f5b640 1 -- 172.21.15.116:0/2389549948 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45200a9ac0 con 0x7f45200a96e0 2024-01-23T07:33:37.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.055+0000 7f4524f5b640 1 --2- 172.21.15.116:0/2389549948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45200a96e0 0x7f45200b1850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4520072780 tx=0x7f451402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645ec9eb84bb8fc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.057+0000 7f372a7fc640 1 -- 172.21.15.116:0/4174286739 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f372c013470 con 0x7f37340a96e0 2024-01-23T07:33:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.058+0000 7f372a7fc640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f371806c8b0 0x7f371806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.058+0000 7f373915a640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f371806c8b0 0x7f371806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.058+0000 7f373915a640 10 monclient: get_auth_request con 0x7f371806c8b0 auth_method 0 2024-01-23T07:33:37.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.058+0000 7f373915a640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f371806c8b0 0x7f371806ed70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3734140920 tx=0x7f3724009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.058+0000 7f372a7fc640 10 client.14288.objecter ms_handle_connect 0x7f371806c8b0 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.060+0000 7f451f7fe640 1 -- 172.21.15.116:0/2389549948 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514031870 con 0x7f45200a96e0 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: dump: 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.061 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 1 -- 172.21.15.116:0/2389549948 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140319d0 con 0x7f45200a96e0 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 1 -- 172.21.15.116:0/2389549948 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514031d60 con 0x7f45200a96e0 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f451f7fe640 10 monclient: dump: 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f45271bf640 5 monclient: authenticate success, global_id 4383 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f45271bf640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:37.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.061+0000 7f45271bf640 4 set_mon_vals no callback set 2024-01-23T07:33:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 10 monclient: shutdown 2024-01-23T07:33:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 -- 172.21.15.116:0/2389549948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45200a96e0 msgr2=0x7f45200b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.065 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 --2- 172.21.15.116:0/2389549948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45200a96e0 0x7f45200b1850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4520072780 tx=0x7f451402b910 comp rx=0 tx=0).stop 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 -- 172.21.15.116:0/2389549948 shutdown_connections 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 --2- 172.21.15.116:0/2389549948 >> v2:172.21.15.173:3300/0 conn(0x7f452013f390 0x7f452013f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 --2- 172.21.15.116:0/2389549948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f45200a96e0 0x7f45200b1850 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 -- 172.21.15.116:0/2389549948 >> 172.21.15.116:0/2389549948 conn(0x7f45200b7bb0 msgr2=0x7f45200b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 -- 172.21.15.116:0/2389549948 shutdown_connections 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 1 -- 172.21.15.116:0/2389549948 wait complete. 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.062+0000 7f45271bf640 10 monclient: monmap: 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.066 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.063+0000 7f45271bf640 1 librados: starting msgr at 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.063+0000 7f45271bf640 1 librados: starting objecter 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.063+0000 7f45271bf640 1 Processor -- start 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.063+0000 7f45271bf640 1 -- start start 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.063+0000 7f45271bf640 1 librados: setting wanted keys 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.063+0000 7f45271bf640 1 librados: calling monclient init 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.063+0000 7f45271bf640 10 monclient: init 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45200a96e0 0x7f45201429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): picked mon.noname-c con 0x7f45200a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f372a7fc640 1 -- 172.21.15.116:0/4174286739 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f372c058bf0 con 0x7f37340a96e0 2024-01-23T07:33:37.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f372a7fc640 10 client.14288.objecter ms_dispatch 0x7f3734000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:37.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f452013f390 0x7f45201405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f372a7fc640 3 client.14288.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:37.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f372a7fc640 3 client.14288.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:37.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): picked mon.noname-a con 0x7f452013f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:37.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f372a7fc640 20 client.14288.objecter dump_active .. 0 homeless 2024-01-23T07:33:37.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4520145600 0x7f4520140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): picked mon.noname-b con 0x7f4520145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:37.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520141040 con 0x7f452013f390 2024-01-23T07:33:37.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4520140130 con 0x7f4520145600 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4520141f40 con 0x7f45200a96e0 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.064+0000 7f45271bf640 10 monclient(hunting): authenticate will time out at 2424.423023s 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.065+0000 7f451ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f452013f390 0x7f45201405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.065+0000 7f451ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f452013f390 0x7f45201405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49010/0 (socket says 172.21.15.116:49010) 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.065+0000 7f451ffff640 1 -- 172.21.15.116:0/1677593574 learned_addr learned my addr 172.21.15.116:0/1677593574 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.065+0000 7f451ffff640 10 monclient(hunting): get_auth_request con 0x7f452013f390 auth_method 0 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.065+0000 7f451ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.065+0000 7f451ffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.065+0000 7f451ffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.066+0000 7f451ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.066+0000 7f451ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.066+0000 7f451ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 10 monclient(hunting): handle_auth_done global_id 4386 payload 824 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 1 -- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45200a96e0 msgr2=0x7f45201429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45200a96e0 0x7f45201429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 1 -- 172.21.15.116:0/1677593574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4520145600 msgr2=0x7f4520140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4520145600 0x7f4520140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 1 monclient: found mon.noname-a 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.069+0000 7f451ffff640 1 -- 172.21.15.116:0/1677593574 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45140094d0 con 0x7f452013f390 2024-01-23T07:33:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.071+0000 7f451ffff640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f452013f390 0x7f45201405c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f450c00b4a0 tx=0x7f450c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.071+0000 7f451d7fa640 10 client.?.objecter ms_handle_connect 0x7f452013f390 2024-01-23T07:33:37.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.071+0000 7f451d7fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:37.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f451d7fa640 1 -- 172.21.15.116:0/1677593574 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c005a10 con 0x7f452013f390 2024-01-23T07:33:37.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f451d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f451d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:37.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f451d7fa640 10 monclient: dump: 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f451d7fa640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f451d7fa640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f451d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f45271bf640 5 monclient: authenticate success, global_id 4386 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f45271bf640 10 monclient: _renew_subs 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f45271bf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4520146320 con 0x7f452013f390 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.074+0000 7f45271bf640 10 client.4386.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.075+0000 7f45271bf640 10 monclient: _renew_subs 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.075+0000 7f45271bf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.075+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45201330c0 con 0x7f452013f390 2024-01-23T07:33:37.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.075+0000 7f45271bf640 1 librados: init done 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.075+0000 7fb97914c640 10 monclient: get_monmap_and_config 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.075+0000 7fb97914c640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.075+0000 7fb97914c640 10 monclient: monmap: 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:37.076240+0000 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:37.076240+0000 2024-01-23T07:33:37.078 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 1 Processor -- start 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 1 -- start start 2024-01-23T07:33:37.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient: init 2024-01-23T07:33:37.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7f45271bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7f45271bf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7f45271bf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.080 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4520067d70 con 0x7f452013f390 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb9740a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb97413faa0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb9740b1850 0x7fb974145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient(hunting): picked mon.noname-a con 0x7fb9740b1850 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9740aac10 con 0x7fb9740a96e0 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9740a9ac0 con 0x7fb97413faa0 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9740a9e00 con 0x7fb9740b1850 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.076+0000 7fb97914c640 10 monclient(hunting): authenticate will time out at 2424.435038s 2024-01-23T07:33:37.122 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-23T07:33:37.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.134+0000 7f2a49ffb640 1 -- 172.21.15.116:0/2230174700 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2a44011e20 con 0x7f2a540a9ac0 2024-01-23T07:33:37.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.134+0000 7f2a49ffb640 10 client.4372.objecter ms_dispatch 0x7f2a54000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:37.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.134+0000 7f2a49ffb640 3 client.4372.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:37.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.134+0000 7f2a49ffb640 3 client.4372.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:37.136 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.134+0000 7f2a49ffb640 20 client.4372.objecter dump_active .. 0 homeless 2024-01-23T07:33:37.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.136+0000 7fdb5d4df640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:37.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.136+0000 7fdb5d4df640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:37.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.136+0000 7fdb5d4df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.137 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.136+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdb58066c50 con 0x7fdb58145c00 2024-01-23T07:33:37.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.147+0000 7f2a49ffb640 1 -- 172.21.15.116:0/2230174700 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2a44054b50 con 0x7f2a540a9ac0 2024-01-23T07:33:37.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.147+0000 7f2a49ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.147+0000 7f2a49ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:37.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.149+0000 7f8d0f7fe640 1 -- 172.21.15.116:0/1448121279 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d18021090 con 0x7f8d280a96e0 2024-01-23T07:33:37.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.149+0000 7f8d0f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:37.149 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.149+0000 7f8d0f7fe640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:37.150 INFO:teuthology.orchestra.run.smithi116.stdout:64424509447 2024-01-23T07:33:37.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.152+0000 7fb96bfff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fb97413faa0 0x7fb974145600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:49978/0 (socket says 172.21.15.116:49978) 2024-01-23T07:33:37.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.152+0000 7fb96bfff640 1 -- 172.21.15.116:0/2879441934 learned_addr learned my addr 172.21.15.116:0/2879441934 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:37.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.152+0000 7f8d2d078640 10 librados: watch_flush enter 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.152+0000 7f8d2d078640 10 librados: watch_flush exit 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.152+0000 7f8d2d078640 20 client.4366.objecter shutdown clearing up homeless session... 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.152+0000 7f8d2d078640 10 client.4366.objecter successfully canceled tick 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f8d1406c8b0 msgr2=0x7f8d1406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f8d1406c8b0 0x7f8d1406ed70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c036000 tx=0x7f8d1c03d040 comp rx=0 tx=0).stop 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 10 monclient: shutdown 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d280a96e0 msgr2=0x7f8d28132c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d280a96e0 0x7f8d28132c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e8e0 tx=0x7f8d1800eda0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 shutdown_connections 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f8d1406c8b0 0x7f8d1406ed70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8d28145600 0x7f8d28131d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f8d2813f390 0x7f8d28133240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 --2- 172.21.15.116:0/1448121279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8d280a96e0 0x7f8d28132c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 >> 172.21.15.116:0/1448121279 conn(0x7f8d280b7bb0 msgr2=0x7f8d28073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 shutdown_connections 2024-01-23T07:33:37.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 -- 172.21.15.116:0/1448121279 wait complete. 2024-01-23T07:33:37.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.153+0000 7f8d2d078640 1 librados: shutdown 2024-01-23T07:33:37.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-01-23T07:33:37.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.224+0000 7f703ded6640 10 monclient: get_monmap_and_config 2024-01-23T07:33:37.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.224+0000 7f703ded6640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.224 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.224+0000 7f703ded6640 10 monclient: monmap: 2024-01-23T07:33:37.224 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.224 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:37.225274+0000 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:37.225274+0000 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:37.225 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.224+0000 7f703ded6640 1 Processor -- start 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.224+0000 7f703ded6640 1 -- start start 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.224+0000 7f703ded6640 10 monclient: init 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient: _add_conns ranks=[2,4,1,0,3] 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70380a96e0 0x7f70380b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient(hunting): picked mon.noname-b con 0x7f70380a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f703813f390 0x7f703813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient(hunting): picked mon.noname-c con 0x7f703813f390 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f7038145600 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380aac10 con 0x7f7038145600 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70380a9e00 con 0x7f703813f390 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703813fd30 con 0x7f70380a96e0 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.225+0000 7f703ded6640 10 monclient(hunting): authenticate will time out at 2424.583709s 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.226+0000 7f7036ffd640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f703813f390 0x7f703813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.226+0000 7f7037fff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f7038145600 0x7f7038145a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:49980/0 (socket says 172.21.15.116:49980) 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.226+0000 7f7037fff640 1 -- 172.21.15.116:0/3994682027 learned_addr learned my addr 172.21.15.116:0/3994682027 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.227+0000 7f7036ffd640 10 monclient(hunting): get_auth_request con 0x7f703813f390 auth_method 0 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.227+0000 7f7036ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.227+0000 7f7036ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.228 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.227+0000 7f7036ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.227+0000 7f7036ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.227+0000 7f7036ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.227+0000 7f7036ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 10 monclient(hunting): handle_auth_done global_id 4375 payload 274 2024-01-23T07:33:37.229 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 1 -- 172.21.15.116:0/3994682027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70380a96e0 msgr2=0x7f70380b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 1 --2- 172.21.15.116:0/3994682027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70380a96e0 0x7f70380b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 1 -- 172.21.15.116:0/3994682027 >> v1:172.21.15.173:6789/0 conn(0x7f7038145600 legacy=0x7f7038145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 1 monclient: found mon.noname-c 2024-01-23T07:33:37.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.229+0000 7f7036ffd640 1 -- 172.21.15.116:0/3994682027 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380a9ac0 con 0x7f703813f390 2024-01-23T07:33:37.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.233+0000 7f7036ffd640 1 --2- 172.21.15.116:0/3994682027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f703813f390 0x7f703813f7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f702c009790 tx=0x7f702c02b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45cd7fcfd5cf6ead server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 1 -- 172.21.15.116:0/3994682027 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c031800 con 0x7f703813f390 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: dump: 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.237 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 1 -- 172.21.15.116:0/3994682027 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c031960 con 0x7f703813f390 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 5 monclient: authenticate success, global_id 4375 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.238 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 4 set_mon_vals no callback set 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 1 -- 172.21.15.116:0/3994682027 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c031cf0 con 0x7f703813f390 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f70367fc640 10 monclient: dump: 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.239 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.240 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 10 monclient: shutdown 2024-01-23T07:33:37.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 -- 172.21.15.116:0/3994682027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f703813f390 msgr2=0x7f703813f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 --2- 172.21.15.116:0/3994682027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f703813f390 0x7f703813f7f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f702c009790 tx=0x7f702c02b8a0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 -- 172.21.15.116:0/3994682027 shutdown_connections 2024-01-23T07:33:37.242 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 --2- 172.21.15.116:0/3994682027 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f703813f390 0x7f703813f7f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 --2- 172.21.15.116:0/3994682027 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f70380a96e0 0x7f70380b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 -- 172.21.15.116:0/3994682027 >> 172.21.15.116:0/3994682027 conn(0x7f70380b7bb0 msgr2=0x7f70380b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 -- 172.21.15.116:0/3994682027 shutdown_connections 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.237+0000 7f703ded6640 1 -- 172.21.15.116:0/3994682027 wait complete. 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.238+0000 7f703ded6640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.238+0000 7f703ded6640 10 monclient: monmap: 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:37.243 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.239+0000 7f703ded6640 1 librados: starting msgr at 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.239+0000 7f703ded6640 1 librados: starting objecter 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.239+0000 7f703ded6640 1 Processor -- start 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.239+0000 7f703ded6640 1 -- start start 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.239+0000 7f703ded6640 1 librados: setting wanted keys 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.239+0000 7f703ded6640 1 librados: calling monclient init 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.239+0000 7f703ded6640 10 monclient: init 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70380a96e0 0x7f70380b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): picked mon.noname-b con 0x7f70380a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f703813f390 0x7f70381db080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.244 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): picked mon.noname-c con 0x7f703813f390 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7038145600 0x7f70381db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): picked mon.noname-a con 0x7f7038145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7038136200 con 0x7f7038145600 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70381379b0 con 0x7f70380a96e0 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70381363e0 con 0x7f703813f390 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.240+0000 7f703ded6640 10 monclient(hunting): authenticate will time out at 2424.598817s 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70380a96e0 0x7f70380b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70380a96e0 0x7f70380b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:37954/0 (socket says 172.21.15.116:37954) 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 1 -- 172.21.15.116:0/4269966864 learned_addr learned my addr 172.21.15.116:0/4269966864 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.245 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 10 monclient(hunting): get_auth_request con 0x7f70380a96e0 auth_method 0 2024-01-23T07:33:37.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.246 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.241+0000 7f70377fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 10 monclient(hunting): handle_auth_done global_id 4378 payload 824 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 1 -- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f703813f390 msgr2=0x7f70381db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f703813f390 0x7f70381db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 1 -- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7038145600 msgr2=0x7f70381db5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7038145600 0x7f70381db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 1 monclient: found mon.noname-b 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.244+0000 7f70377fe640 1 -- 172.21.15.116:0/4269966864 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0093a0 con 0x7f70380a96e0 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.246+0000 7f70377fe640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70380a96e0 0x7f70380b64c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f702800b4a0 tx=0x7f702800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.247 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.246+0000 7f701ffff640 10 client.?.objecter ms_handle_connect 0x7f70380a96e0 2024-01-23T07:33:37.248 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.246+0000 7f701ffff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:37.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 1 -- 172.21.15.116:0/4269966864 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028010610 con 0x7f70380a96e0 2024-01-23T07:33:37.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:37.250 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: dump: 2024-01-23T07:33:37.250 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 1 -- 172.21.15.116:0/4269966864 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7028010770 con 0x7f70380a96e0 2024-01-23T07:33:37.251 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 5 monclient: authenticate success, global_id 4378 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 10 monclient: _renew_subs 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70381dbb00 con 0x7f70380a96e0 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 1 -- 172.21.15.116:0/4269966864 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028010b20 con 0x7f70380a96e0 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f701ffff640 10 monclient: dump: 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.252 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f7035ffb640 4 set_mon_vals no callback set 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 10 client.4378.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 10 monclient: _renew_subs 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70381448c0 con 0x7f70380a96e0 2024-01-23T07:33:37.253 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.250+0000 7f703ded6640 1 librados: init done 2024-01-23T07:33:37.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.251+0000 7f703ded6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.251+0000 7f703ded6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.251+0000 7f703ded6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.254 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.251+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7038067d70 con 0x7f70380a96e0 2024-01-23T07:33:37.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.270+0000 7f701ffff640 1 -- 172.21.15.116:0/4269966864 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f7028010c80 con 0x7f70380a96e0 2024-01-23T07:33:37.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.270+0000 7f701ffff640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f702406c860 0x7f702406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.270+0000 7f7036ffd640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f702406c860 0x7f702406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.270+0000 7f7036ffd640 10 monclient: get_auth_request con 0x7f702406c860 auth_method 0 2024-01-23T07:33:37.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.270+0000 7f701ffff640 10 client.4378.objecter ms_handle_connect 0x7f702406c860 2024-01-23T07:33:37.271 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.270+0000 7f7036ffd640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f702406c860 0x7f702406ed20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f702c036000 tx=0x7f702c030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.272 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.272+0000 7f701ffff640 1 -- 172.21.15.116:0/4269966864 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7028058970 con 0x7f70380a96e0 2024-01-23T07:33:37.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.272+0000 7f701ffff640 10 client.4378.objecter ms_dispatch 0x7f7038000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:37.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.272+0000 7f701ffff640 3 client.4378.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:37.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.272+0000 7f701ffff640 3 client.4378.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:37.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.272+0000 7f701ffff640 20 client.4378.objecter dump_active .. 0 homeless 2024-01-23T07:33:37.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.293+0000 7f451d7fa640 1 -- 172.21.15.116:0/1677593574 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450c005b70 con 0x7f452013f390 2024-01-23T07:33:37.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.293+0000 7f451d7fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.293+0000 7f451effd640 4 set_mon_vals no callback set 2024-01-23T07:33:37.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.312+0000 7f372a7fc640 1 -- 172.21.15.116:0/4174286739 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f372c054f30 con 0x7f37340a96e0 2024-01-23T07:33:37.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.312+0000 7f372a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.312+0000 7f372a7fc640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:37.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.324+0000 7fdb3f7fe640 1 -- 172.21.15.116:0/3549707210 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb48015020 con 0x7fdb58145c00 2024-01-23T07:33:37.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.324+0000 7fdb3f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:37.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.324+0000 7fdb3f7fe640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:37.324 INFO:teuthology.orchestra.run.smithi116.stdout:68719476741 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 10 librados: watch_flush enter 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 10 librados: watch_flush exit 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 20 client.14282.objecter shutdown clearing up homeless session... 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 10 client.14282.objecter successfully canceled tick 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb4406c8b0 msgr2=0x7fdb4406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb4406c8b0 0x7fdb4406ed70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdb50036000 tx=0x7fdb5002e000 comp rx=0 tx=0).stop 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 10 monclient: shutdown 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb58145c00 msgr2=0x7fdb5813d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb58145c00 0x7fdb5813d4d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800b410 tx=0x7fdb4800b8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 shutdown_connections 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fdb4406c8b0 0x7fdb4406ed70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fdb58145c00 0x7fdb5813d4d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb580b4890 0x7fdb58141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 --2- 172.21.15.116:0/3549707210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb580b1ff0 0x7fdb58142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 >> 172.21.15.116:0/3549707210 conn(0x7fdb58066450 msgr2=0x7fdb58136a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 shutdown_connections 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 -- 172.21.15.116:0/3549707210 wait complete. 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.326+0000 7fdb5d4df640 1 librados: shutdown 2024-01-23T07:33:37.328 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.327+0000 7fb97359e640 1 --2- 172.21.15.116:0/2879441934 >> v2:172.21.15.116:3300/0 conn(0x7fb9740b1850 0x7fb974145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.334+0000 7f451d7fa640 1 -- 172.21.15.116:0/1677593574 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c010610 con 0x7f452013f390 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.334+0000 7f451d7fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.334+0000 7f451d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.334+0000 7f451d7fa640 10 monclient: dump: 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.334 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.335 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.335 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.335 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.335 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.2 2024-01-23T07:33:37.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.349+0000 7f451d7fa640 1 -- 172.21.15.116:0/1677593574 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f450c010770 con 0x7f452013f390 2024-01-23T07:33:37.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.350+0000 7f451d7fa640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f450406c860 0x7f450406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.350+0000 7f4524f5b640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f450406c860 0x7f450406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.350+0000 7f4524f5b640 10 monclient: get_auth_request con 0x7f450406c860 auth_method 0 2024-01-23T07:33:37.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.350+0000 7f451d7fa640 10 client.4386.objecter ms_handle_connect 0x7f450406c860 2024-01-23T07:33:37.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.350+0000 7f4524f5b640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f450406c860 0x7f450406ed20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4514036000 tx=0x7f4514030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.352+0000 7f2a5b5b1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:37.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.352+0000 7f2a5b5b1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:37.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.352+0000 7f2a5b5b1640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.352+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a5413c550 con 0x7f2a540a9ac0 2024-01-23T07:33:37.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 1 -- 172.21.15.116:0/1677593574 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f450c0585e0 con 0x7f452013f390 2024-01-23T07:33:37.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 10 client.4386.objecter ms_dispatch 0x7f4520000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:37.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 3 client.4386.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:37.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 3 client.4386.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:37.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7fb97359e640 10 monclient(hunting): get_auth_request con 0x7fb9740b1850 auth_method 0 2024-01-23T07:33:37.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7fb97359e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.363 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7fb97359e640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7fb97359e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 20 client.4386.objecter dump_active .. 0 homeless 2024-01-23T07:33:37.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 1 -- 172.21.15.116:0/1677593574 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f450c057cb0 con 0x7f452013f390 2024-01-23T07:33:37.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.364 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.363+0000 7f451d7fa640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:37.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.365+0000 7fb97359e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.365+0000 7fb97359e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.365 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.365+0000 7fb97359e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 10 monclient(hunting): handle_auth_done global_id 4389 payload 274 2024-01-23T07:33:37.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 1 -- 172.21.15.116:0/2879441934 >> v1:172.21.15.173:6789/0 conn(0x7fb97413faa0 legacy=0x7fb974145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 1 -- 172.21.15.116:0/2879441934 >> v1:172.21.15.116:6789/0 conn(0x7fb9740a96e0 legacy=0x7fb97413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.369 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 1 monclient: found mon.noname-a 2024-01-23T07:33:37.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.370 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.369+0000 7fb97359e640 1 -- 172.21.15.116:0/2879441934 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740aae80 con 0x7fb9740b1850 2024-01-23T07:33:37.396 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.395+0000 7fb97359e640 1 --2- 172.21.15.116:0/2879441934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740b1850 0x7fb974145d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009d90 tx=0x7fb96c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da1edb62d787a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 1 -- 172.21.15.116:0/2879441934 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c02cc60 con 0x7fb9740b1850 2024-01-23T07:33:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: dump: 2024-01-23T07:33:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.479 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 1 -- 172.21.15.116:0/2879441934 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96c02cdc0 con 0x7fb9740b1850 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 1 -- 172.21.15.116:0/2879441934 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96c034660 con 0x7fb9740b1850 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97259c640 10 monclient: dump: 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.481 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.482 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97914c640 5 monclient: authenticate success, global_id 4389 2024-01-23T07:33:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97914c640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:37.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.478+0000 7fb97914c640 4 set_mon_vals no callback set 2024-01-23T07:33:37.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 10 monclient: shutdown 2024-01-23T07:33:37.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 1 -- 172.21.15.116:0/2879441934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740b1850 msgr2=0x7fb974145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 1 --2- 172.21.15.116:0/2879441934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740b1850 0x7fb974145d10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009d90 tx=0x7fb96c02beb0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 1 -- 172.21.15.116:0/2879441934 shutdown_connections 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 1 --2- 172.21.15.116:0/2879441934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740b1850 0x7fb974145d10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 1 -- 172.21.15.116:0/2879441934 >> 172.21.15.116:0/2879441934 conn(0x7fb9740b7bb0 msgr2=0x7fb9740b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 1 -- 172.21.15.116:0/2879441934 shutdown_connections 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.479+0000 7fb97914c640 1 -- 172.21.15.116:0/2879441934 wait complete. 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 10 monclient: monmap: 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:37.485 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 1 librados: starting msgr at 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 1 librados: starting objecter 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 1 Processor -- start 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 1 -- start start 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 1 librados: setting wanted keys 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 1 librados: calling monclient init 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.481+0000 7fb97914c640 10 monclient: init 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740a96e0 0x7fb974133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): picked mon.noname-a con 0x7fb9740a96e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9740b1850 0x7fb97412ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): picked mon.noname-c con 0x7fb9740b1850 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb97413faa0 0x7fb97412f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): picked mon.noname-b con 0x7fb97413faa0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974143870 con 0x7fb9740a96e0 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974144bd0 con 0x7fb97413faa0 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97412f650 con 0x7fb9740b1850 2024-01-23T07:33:37.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.482+0000 7fb97914c640 10 monclient(hunting): authenticate will time out at 2424.841005s 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.483+0000 7fb972d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740a96e0 0x7fb974133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.483+0000 7fb972d9d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740a96e0 0x7fb974133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49046/0 (socket says 172.21.15.116:49046) 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.483+0000 7fb972d9d640 1 -- 172.21.15.116:0/156179728 learned_addr learned my addr 172.21.15.116:0/156179728 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.483+0000 7fb972d9d640 10 monclient(hunting): get_auth_request con 0x7fb9740a96e0 auth_method 0 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.483+0000 7fb972d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.483+0000 7fb972d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.483+0000 7fb972d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.484+0000 7fb972d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.484+0000 7fb972d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.484+0000 7fb972d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.488+0000 7fb972d9d640 10 monclient(hunting): handle_auth_done global_id 4392 payload 824 2024-01-23T07:33:37.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.488+0000 7fb972d9d640 1 -- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9740b1850 msgr2=0x7fb97412ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.488+0000 7fb972d9d640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9740b1850 0x7fb97412ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.489+0000 7fb972d9d640 1 -- 172.21.15.116:0/156179728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb97413faa0 msgr2=0x7fb97412f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.489+0000 7fb972d9d640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb97413faa0 0x7fb97412f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.489+0000 7fb972d9d640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.489+0000 7fb972d9d640 1 monclient: found mon.noname-a 2024-01-23T07:33:37.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.489+0000 7fb972d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.489+0000 7fb972d9d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.490 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.489+0000 7fb972d9d640 1 -- 172.21.15.116:0/156179728 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c009a70 con 0x7fb9740a96e0 2024-01-23T07:33:37.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.492+0000 7fb972d9d640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740a96e0 0x7fb974133c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c410 tx=0x7fb96400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.492+0000 7fb96b7fe640 10 client.?.objecter ms_handle_connect 0x7fb9740a96e0 2024-01-23T07:33:37.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.492+0000 7fb96b7fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:37.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 1 -- 172.21.15.116:0/156179728 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640035f0 con 0x7fb9740a96e0 2024-01-23T07:33:37.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:37.498 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: dump: 2024-01-23T07:33:37.498 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.498 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.498 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 1 -- 172.21.15.116:0/156179728 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964003750 con 0x7fb9740a96e0 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 1 -- 172.21.15.116:0/156179728 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964003b00 con 0x7fb9740a96e0 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb96b7fe640 10 monclient: dump: 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 5 monclient: authenticate success, global_id 4392 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 10 monclient: _renew_subs 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb971d9b640 4 set_mon_vals no callback set 2024-01-23T07:33:37.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97413e3b0 con 0x7fb9740a96e0 2024-01-23T07:33:37.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 10 client.4392.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:37.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 10 monclient: _renew_subs 2024-01-23T07:33:37.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb974143b50 con 0x7fb9740a96e0 2024-01-23T07:33:37.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.497+0000 7fb97914c640 1 librados: init done 2024-01-23T07:33:37.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.499+0000 7fb97914c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.499+0000 7fb97914c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.499+0000 7fb97914c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.499+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb974067d70 con 0x7fb9740a96e0 2024-01-23T07:33:37.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.501+0000 7f373bbbf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:37.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.501+0000 7f373bbbf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:37.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.501+0000 7f373bbbf640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.501+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3734068170 con 0x7f37340a96e0 2024-01-23T07:33:37.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.511+0000 7f372a7fc640 1 -- 172.21.15.116:0/4174286739 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f372c021090 con 0x7f37340a96e0 2024-01-23T07:33:37.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.511+0000 7f372a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:37.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.511+0000 7f372a7fc640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:37.511 INFO:teuthology.orchestra.run.smithi116.stdout:77309411336 2024-01-23T07:33:37.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.512+0000 7f701ffff640 1 -- 172.21.15.116:0/4269966864 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f70280545b0 con 0x7f70380a96e0 2024-01-23T07:33:37.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.512+0000 7f701ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.512+0000 7f701ffff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 10 librados: watch_flush enter 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 10 librados: watch_flush exit 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 20 client.14288.objecter shutdown clearing up homeless session... 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 10 client.14288.objecter successfully canceled tick 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f371806c8b0 msgr2=0x7f371806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f371806c8b0 0x7f371806ed70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3734140920 tx=0x7f3724009040 comp rx=0 tx=0).stop 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 10 monclient: shutdown 2024-01-23T07:33:37.514 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37340a96e0 msgr2=0x7f373413fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37340a96e0 0x7f373413fee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f372c00e9b0 tx=0x7f372c00ee70 comp rx=0 tx=0).stop 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 shutdown_connections 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f371806c8b0 0x7f371806ed70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3734145600 0x7f3734138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f373413f390 0x7f37340b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 --2- 172.21.15.116:0/4174286739 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f37340a96e0 0x7f373413fee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 >> 172.21.15.116:0/4174286739 conn(0x7f37340b7bb0 msgr2=0x7f37340b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 shutdown_connections 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 -- 172.21.15.116:0/4174286739 wait complete. 2024-01-23T07:33:37.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.513+0000 7f373bbbf640 1 librados: shutdown 2024-01-23T07:33:37.519 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-23T07:33:37.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.519+0000 7f2a49ffb640 1 -- 172.21.15.116:0/2230174700 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a44058170 con 0x7f2a540a9ac0 2024-01-23T07:33:37.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.519+0000 7f2a49ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:37.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.519+0000 7f2a49ffb640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:37.520 INFO:teuthology.orchestra.run.smithi116.stdout:60129542149 2024-01-23T07:33:37.526 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.525+0000 7f2a5b5b1640 10 librados: watch_flush enter 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 10 librados: watch_flush exit 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 20 client.4372.objecter shutdown clearing up homeless session... 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 10 client.4372.objecter successfully canceled tick 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2a3806c8e0 msgr2=0x7f2a3806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2a3806c8e0 0x7f2a3806eda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2a50006a90 tx=0x7f2a50006a20 comp rx=0 tx=0).stop 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 10 monclient: shutdown 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a540a9ac0 msgr2=0x7f2a5413be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a540a9ac0 0x7f2a5413be80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c3f0 tx=0x7f2a4400c8b0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 shutdown_connections 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2a3806c8e0 0x7f2a3806eda0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2a54145200 0x7f2a541456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a540a9ac0 0x7f2a5413be80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 --2- 172.21.15.116:0/2230174700 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2a540a96e0 0x7f2a54143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 >> 172.21.15.116:0/2230174700 conn(0x7f2a540b7bb0 msgr2=0x7f2a540b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 shutdown_connections 2024-01-23T07:33:37.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.526+0000 7f2a5b5b1640 1 -- 172.21.15.116:0/2230174700 wait complete. 2024-01-23T07:33:37.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.527+0000 7f2a5b5b1640 1 librados: shutdown 2024-01-23T07:33:37.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411337 got 77309411336 for osd.4 2024-01-23T07:33:37.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.0 2024-01-23T07:33:37.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.602+0000 7f45271bf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:37.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.602+0000 7f45271bf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:37.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.602+0000 7f45271bf640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.603 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.603+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f452013ff30 con 0x7f452013f390 2024-01-23T07:33:37.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.626+0000 7fd27ddae640 10 monclient: get_monmap_and_config 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.626+0000 7fd27ddae640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.626+0000 7fd27ddae640 10 monclient: monmap: 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:37.628030+0000 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:37.628030+0000 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:37.627 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:37.628 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:37.628 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:37.628 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.627+0000 7fd27ddae640 1 Processor -- start 2024-01-23T07:33:37.630 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.627+0000 7fd27ddae640 1 -- start start 2024-01-23T07:33:37.631 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.627+0000 7fd27ddae640 10 monclient: init 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd2780a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a9ac0 0x7fd27813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient(hunting): picked mon.noname-b con 0x7fd2780a9ac0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2780b25b0 0x7fd27813f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient(hunting): picked mon.noname-c con 0x7fd2780b25b0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780aa880 con 0x7fd2780a96e0 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780aaad0 con 0x7fd2780b25b0 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780aadb0 con 0x7fd2780a9ac0 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd27ddae640 10 monclient(hunting): authenticate will time out at 2424.986430s 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd276ffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a9ac0 0x7fd27813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.628+0000 7fd277fff640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd2780b25b0 0x7fd27813f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a9ac0 0x7fd27813f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36496/0 (socket says 172.21.15.116:36496) 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 1 -- 172.21.15.116:0/4177467892 learned_addr learned my addr 172.21.15.116:0/4177467892 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 10 monclient(hunting): get_auth_request con 0x7fd2780a9ac0 auth_method 0 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd277fff640 10 monclient(hunting): get_auth_request con 0x7fd2780b25b0 auth_method 0 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd277fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd277fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd277fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd276ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd277fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd277fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.629+0000 7fd277fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 10 monclient(hunting): handle_auth_done global_id 14291 payload 274 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 1 -- 172.21.15.116:0/4177467892 >> v2:172.21.15.173:3300/0 conn(0x7fd2780b25b0 msgr2=0x7fd27813f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 1 --2- 172.21.15.116:0/4177467892 >> v2:172.21.15.173:3300/0 conn(0x7fd2780b25b0 0x7fd27813f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 1 -- 172.21.15.116:0/4177467892 >> v1:172.21.15.116:6789/0 conn(0x7fd2780a96e0 legacy=0x7fd2781427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 1 monclient: found mon.noname-b 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:37.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.631+0000 7fd276ffd640 1 -- 172.21.15.116:0/4177467892 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780ab090 con 0x7fd2780a9ac0 2024-01-23T07:33:37.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.633+0000 7fd276ffd640 1 --2- 172.21.15.116:0/4177467892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a9ac0 0x7fd27813f420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009850 tx=0x7fd26c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82c1ac3c6720cf02 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 1 -- 172.21.15.116:0/4177467892 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c004230 con 0x7fd2780a9ac0 2024-01-23T07:33:37.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:37.638 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: dump: 2024-01-23T07:33:37.638 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.638 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.638 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 1 -- 172.21.15.116:0/4177467892 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c004390 con 0x7fd2780a9ac0 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 5 monclient: authenticate success, global_id 14291 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:37.639 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 1 -- 172.21.15.116:0/4177467892 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c031830 con 0x7fd2780a9ac0 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 4 set_mon_vals no callback set 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd2767fc640 10 monclient: dump: 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.640 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.641 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.641 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.641 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 10 monclient: shutdown 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 1 -- 172.21.15.116:0/4177467892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a9ac0 msgr2=0x7fd27813f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 1 --2- 172.21.15.116:0/4177467892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a9ac0 0x7fd27813f420 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009850 tx=0x7fd26c02b8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 1 -- 172.21.15.116:0/4177467892 shutdown_connections 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 1 --2- 172.21.15.116:0/4177467892 >> v2:172.21.15.173:3300/0 conn(0x7fd2780b25b0 0x7fd27813f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 1 --2- 172.21.15.116:0/4177467892 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a9ac0 0x7fd27813f420 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 1 -- 172.21.15.116:0/4177467892 >> 172.21.15.116:0/4177467892 conn(0x7fd2780b7bb0 msgr2=0x7fd2780b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.638+0000 7fd27ddae640 1 -- 172.21.15.116:0/4177467892 shutdown_connections 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.639+0000 7fd27ddae640 1 -- 172.21.15.116:0/4177467892 wait complete. 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.639+0000 7fd27ddae640 10 monclient: build_initial_monmap 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.639+0000 7fd27ddae640 10 monclient: monmap: 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:37.645 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.640+0000 7fd27ddae640 1 librados: starting msgr at 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.640+0000 7fd27ddae640 1 librados: starting objecter 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.640+0000 7fd27ddae640 1 Processor -- start 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.640+0000 7fd27ddae640 1 -- start start 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.640+0000 7fd27ddae640 1 librados: setting wanted keys 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.640+0000 7fd27ddae640 1 librados: calling monclient init 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.640+0000 7fd27ddae640 10 monclient: init 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a96e0 0x7fd27813c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): picked mon.noname-c con 0x7fd2780a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2780a9ac0 0x7fd2781380d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): picked mon.noname-a con 0x7fd2780a9ac0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:37.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2780b25b0 0x7fd278138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): picked mon.noname-b con 0x7fd2780b25b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd278136330 con 0x7fd2780a9ac0 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd278138b50 con 0x7fd2780b25b0 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2781376f0 con 0x7fd2780a96e0 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd27ddae640 10 monclient(hunting): authenticate will time out at 2424.999402s 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd2777fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a96e0 0x7fd27813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd2777fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a96e0 0x7fd27813c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36502/0 (socket says 172.21.15.116:36502) 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd2777fe640 1 -- 172.21.15.116:0/2491051904 learned_addr learned my addr 172.21.15.116:0/2491051904 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd2777fe640 10 monclient(hunting): get_auth_request con 0x7fd2780a96e0 auth_method 0 2024-01-23T07:33:37.647 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd2777fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd2777fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.641+0000 7fd2777fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2780b25b0 0x7fd278138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 10 monclient(hunting): get_auth_request con 0x7fd2780b25b0 auth_method 0 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd2777fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd2777fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd2777fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:37.648 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.642+0000 7fd277fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:37.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 10 monclient(hunting): handle_auth_done global_id 4384 payload 824 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 1 -- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a96e0 msgr2=0x7fd27813c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a96e0 0x7fd27813c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 1 -- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2780a9ac0 msgr2=0x7fd2781380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2780a9ac0 0x7fd2781380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 1 monclient: found mon.noname-b 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd277fff640 1 -- 172.21.15.116:0/2491051904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c009460 con 0x7fd2780b25b0 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.645+0000 7fd2777fe640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a96e0 0x7fd27813c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.647+0000 7fd277fff640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2780b25b0 0x7fd278138610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd27000eb70 tx=0x7fd27000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.647+0000 7fd25ffff640 10 client.?.objecter ms_handle_connect 0x7fd2780b25b0 2024-01-23T07:33:37.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.647+0000 7fd25ffff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.650+0000 7fd25ffff640 1 -- 172.21.15.116:0/2491051904 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27000cd20 con 0x7fd2780b25b0 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.650+0000 7fd25ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.650+0000 7fd25ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.650+0000 7fd25ffff640 10 monclient: dump: 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.652 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 10 monclient: _finish_auth 0 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 1 -- 172.21.15.116:0/2491051904 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27000f040 con 0x7fd2780b25b0 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 1 -- 172.21.15.116:0/2491051904 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2700146c0 con 0x7fd2780b25b0 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 5 monclient: authenticate success, global_id 4384 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:37.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd25ffff640 10 monclient: dump: 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 monclient: _renew_subs 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2781379d0 con 0x7fd2780b25b0 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd275ffb640 4 set_mon_vals no callback set 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 client.4384.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 monclient: _renew_subs 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2781367c0 con 0x7fd2780b25b0 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 1 librados: init done 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.651+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd278067d70 con 0x7fd2780b25b0 2024-01-23T07:33:37.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.669+0000 7fd25ffff640 1 -- 172.21.15.116:0/2491051904 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd270014820 con 0x7fd2780b25b0 2024-01-23T07:33:37.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.670+0000 7fd25ffff640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd26406c860 0x7fd26406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.670+0000 7fd2777fe640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd26406c860 0x7fd26406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.670+0000 7fd2777fe640 10 monclient: get_auth_request con 0x7fd26406c860 auth_method 0 2024-01-23T07:33:37.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.670+0000 7fd25ffff640 10 client.4384.objecter ms_handle_connect 0x7fd26406c860 2024-01-23T07:33:37.670 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.670+0000 7fd2777fe640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd26406c860 0x7fd26406ed20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd268001c80 tx=0x7fd268009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.672+0000 7fd25ffff640 1 -- 172.21.15.116:0/2491051904 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd270059ba0 con 0x7fd2780b25b0 2024-01-23T07:33:37.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.672+0000 7fd25ffff640 10 client.4384.objecter ms_dispatch 0x7fd278000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:37.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.672+0000 7fd25ffff640 3 client.4384.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:37.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.672+0000 7fd25ffff640 3 client.4384.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:37.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.672+0000 7fd25ffff640 20 client.4384.objecter dump_active .. 0 homeless 2024-01-23T07:33:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.702+0000 7f703ded6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.702+0000 7f703ded6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.702+0000 7f703ded6640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:37.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.702+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f703804ea10 con 0x7f70380a96e0 2024-01-23T07:33:37.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.765+0000 7fb96b7fe640 1 -- 172.21.15.116:0/156179728 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb964003c60 con 0x7fb9740a96e0 2024-01-23T07:33:37.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.765+0000 7fb96b7fe640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb95406c860 0x7fb95406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:37.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.765+0000 7fb96bfff640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb95406c860 0x7fb95406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:37.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.765+0000 7fb96bfff640 10 monclient: get_auth_request con 0x7fb95406c860 auth_method 0 2024-01-23T07:33:37.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.766+0000 7fb96b7fe640 10 client.4392.objecter ms_handle_connect 0x7fb95406c860 2024-01-23T07:33:37.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.766+0000 7fb96bfff640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb95406c860 0x7fb95406ed20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000fb0 tx=0x7fb95c007a70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.778+0000 7fb96b7fe640 1 -- 172.21.15.116:0/156179728 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb964057e30 con 0x7fb9740a96e0 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.778+0000 7fb96b7fe640 10 client.4392.objecter ms_dispatch 0x7fb974000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.778+0000 7fb96b7fe640 3 client.4392.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.778+0000 7fb96b7fe640 3 client.4392.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.779+0000 7fb96b7fe640 20 client.4392.objecter dump_active .. 0 homeless 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.779+0000 7fb96b7fe640 1 -- 172.21.15.116:0/156179728 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb964053a70 con 0x7fb9740a96e0 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.779+0000 7fb96b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.779+0000 7fb96b7fe640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:37.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.787+0000 7f451d7fa640 1 -- 172.21.15.116:0/1677593574 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f450c014090 con 0x7f452013f390 2024-01-23T07:33:37.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.787+0000 7f451d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:37.787 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.787+0000 7f451d7fa640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:37.788 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-01-23T07:33:37.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 10 librados: watch_flush enter 2024-01-23T07:33:37.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 10 librados: watch_flush exit 2024-01-23T07:33:37.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 20 client.4386.objecter shutdown clearing up homeless session... 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 10 client.4386.objecter successfully canceled tick 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f450406c860 msgr2=0x7f450406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f450406c860 0x7f450406ed20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4514036000 tx=0x7f4514030000 comp rx=0 tx=0).stop 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 10 monclient: shutdown 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f452013f390 msgr2=0x7f45201405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f452013f390 0x7f45201405c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f450c00b4a0 tx=0x7f450c00b960 comp rx=0 tx=0).stop 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 shutdown_connections 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f450406c860 0x7f450406ed20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4520145600 0x7f4520140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f452013f390 0x7f45201405c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 --2- 172.21.15.116:0/1677593574 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f45200a96e0 0x7f45201429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.789+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 >> 172.21.15.116:0/1677593574 conn(0x7f45200b7bb0 msgr2=0x7f452013a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.791 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.790+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 shutdown_connections 2024-01-23T07:33:37.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.790+0000 7f45271bf640 1 -- 172.21.15.116:0/1677593574 wait complete. 2024-01-23T07:33:37.792 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.790+0000 7f45271bf640 1 librados: shutdown 2024-01-23T07:33:37.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-01-23T07:33:37.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.904+0000 7f701ffff640 1 -- 172.21.15.116:0/4269966864 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f702801e020 con 0x7f70380a96e0 2024-01-23T07:33:37.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.904+0000 7f701ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:37.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.904+0000 7f701ffff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:37.905 INFO:teuthology.orchestra.run.smithi116.stdout:55834574853 2024-01-23T07:33:37.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 10 librados: watch_flush enter 2024-01-23T07:33:37.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 10 librados: watch_flush exit 2024-01-23T07:33:37.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 20 client.4378.objecter shutdown clearing up homeless session... 2024-01-23T07:33:37.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 10 client.4378.objecter successfully canceled tick 2024-01-23T07:33:37.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f702406c860 msgr2=0x7f702406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f702406c860 0x7f702406ed20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f702c036000 tx=0x7f702c030000 comp rx=0 tx=0).stop 2024-01-23T07:33:37.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 10 monclient: shutdown 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70380a96e0 msgr2=0x7f70380b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70380a96e0 0x7f70380b64c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f702800b4a0 tx=0x7f702800b960 comp rx=0 tx=0).stop 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 shutdown_connections 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f702406c860 0x7f702406ed20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7038145600 0x7f70381db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f703813f390 0x7f70381db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 --2- 172.21.15.116:0/4269966864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70380a96e0 0x7f70380b64c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 >> 172.21.15.116:0/4269966864 conn(0x7f70380b7bb0 msgr2=0x7f7038073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 shutdown_connections 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 -- 172.21.15.116:0/4269966864 wait complete. 2024-01-23T07:33:37.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.906+0000 7f703ded6640 1 librados: shutdown 2024-01-23T07:33:37.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.915+0000 7fd25ffff640 1 -- 172.21.15.116:0/2491051904 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd2700557e0 con 0x7fd2780b25b0 2024-01-23T07:33:37.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.915+0000 7fd25ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:37.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.915+0000 7fd25ffff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:37.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-01-23T07:33:37.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.972+0000 7fb97914c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-01-23T07:33:37.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.972+0000 7fb97914c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-01-23T07:33:37.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.972+0000 7fb97914c640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:37.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.972+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb97404ea10 con 0x7fb9740a96e0 2024-01-23T07:33:37.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.978+0000 7fb96b7fe640 1 -- 172.21.15.116:0/156179728 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb964017070 con 0x7fb9740a96e0 2024-01-23T07:33:37.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.978+0000 7fb96b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-01-23T07:33:37.979 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.978+0000 7fb96b7fe640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:37.979 INFO:teuthology.orchestra.run.smithi116.stdout:81604378634 2024-01-23T07:33:37.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 10 librados: watch_flush enter 2024-01-23T07:33:37.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 10 librados: watch_flush exit 2024-01-23T07:33:37.981 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 20 client.4392.objecter shutdown clearing up homeless session... 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 10 client.4392.objecter successfully canceled tick 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb95406c860 msgr2=0x7fb95406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb95406c860 0x7fb95406ed20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb95c000fb0 tx=0x7fb95c007a70 comp rx=0 tx=0).stop 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 10 monclient: shutdown 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740a96e0 msgr2=0x7fb974133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740a96e0 0x7fb974133c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb96400c410 tx=0x7fb96400c8d0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 shutdown_connections 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb95406c860 0x7fb95406ed20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb97413faa0 0x7fb97412f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb9740b1850 0x7fb97412ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 --2- 172.21.15.116:0/156179728 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb9740a96e0 0x7fb974133c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:37.982 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.980+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 >> 172.21.15.116:0/156179728 conn(0x7fb9740b7bb0 msgr2=0x7fb97413bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:37.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.981+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 shutdown_connections 2024-01-23T07:33:37.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.981+0000 7fb97914c640 1 -- 172.21.15.116:0/156179728 wait complete. 2024-01-23T07:33:37.983 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:37.981+0000 7fb97914c640 1 librados: shutdown 2024-01-23T07:33:37.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 81604378633 got 81604378634 for osd.1 2024-01-23T07:33:37.992 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:38.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.093+0000 7fd27ddae640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-01-23T07:33:38.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.093+0000 7fd27ddae640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-01-23T07:33:38.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.093+0000 7fd27ddae640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:38.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.093+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd2781364a0 con 0x7fd2780b25b0 2024-01-23T07:33:38.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.097+0000 7fd25ffff640 1 -- 172.21.15.116:0/2491051904 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd270018020 con 0x7fd2780b25b0 2024-01-23T07:33:38.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.097+0000 7fd25ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-01-23T07:33:38.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.097+0000 7fd25ffff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:38.098 INFO:teuthology.orchestra.run.smithi116.stdout:81604378636 2024-01-23T07:33:38.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 10 librados: watch_flush enter 2024-01-23T07:33:38.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 10 librados: watch_flush exit 2024-01-23T07:33:38.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 20 client.4384.objecter shutdown clearing up homeless session... 2024-01-23T07:33:38.100 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 10 client.4384.objecter successfully canceled tick 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd26406c860 msgr2=0x7fd26406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd26406c860 0x7fd26406ed20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd268001c80 tx=0x7fd268009040 comp rx=0 tx=0).stop 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 10 monclient: shutdown 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2780b25b0 msgr2=0x7fd278138610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2780b25b0 0x7fd278138610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd27000eb70 tx=0x7fd27000c490 comp rx=0 tx=0).stop 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 shutdown_connections 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd26406c860 0x7fd26406ed20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2780b25b0 0x7fd278138610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd2780a9ac0 0x7fd2781380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 --2- 172.21.15.116:0/2491051904 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd2780a96e0 0x7fd27813c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.099+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 >> 172.21.15.116:0/2491051904 conn(0x7fd2780b7bb0 msgr2=0x7fd27813f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.100+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 shutdown_connections 2024-01-23T07:33:38.101 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.100+0000 7fd27ddae640 1 -- 172.21.15.116:0/2491051904 wait complete. 2024-01-23T07:33:38.102 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.100+0000 7fd27ddae640 1 librados: shutdown 2024-01-23T07:33:38.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 81604378635 got 81604378636 for osd.3 2024-01-23T07:33:38.111 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:38.170 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-23T07:33:38.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.270+0000 7f3035c2a640 10 monclient: get_monmap_and_config 2024-01-23T07:33:38.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.270+0000 7f3035c2a640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.270 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.270+0000 7f3035c2a640 10 monclient: monmap: 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:38.271640+0000 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:38.271640+0000 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:38.271 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 1 Processor -- start 2024-01-23T07:33:38.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 1 -- start start 2024-01-23T07:33:38.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient: init 2024-01-23T07:33:38.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient: _add_conns ranks=[0,3,2,4,1] 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f303006ba10 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f303006bdf0 0x7f30300b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient(hunting): picked mon.noname-a con 0x7f303006bdf0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30300ae400 0x7f30300ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient(hunting): picked mon.noname-b con 0x7f30300ae400 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30300add00 con 0x7f303006ba10 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303006c280 con 0x7f303006bdf0 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30300adfe0 con 0x7f30300ae400 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.271+0000 7f3035c2a640 10 monclient(hunting): authenticate will time out at 2425.630013s 2024-01-23T07:33:38.274 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30300ae400 0x7f30300ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302effd640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f303006bdf0 0x7f30300b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302ffff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30300ae400 0x7f30300ae820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36510/0 (socket says 172.21.15.116:36510) 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302ffff640 1 -- 172.21.15.116:0/2810573428 learned_addr learned my addr 172.21.15.116:0/2810573428 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302ffff640 10 monclient(hunting): get_auth_request con 0x7f30300ae400 auth_method 0 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302ffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.272+0000 7f302ffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.273+0000 7f302ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.273+0000 7f302ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.273+0000 7f302ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.273+0000 7f302effd640 10 monclient(hunting): get_auth_request con 0x7f303006bdf0 auth_method 0 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.273+0000 7f302effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.273+0000 7f302effd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.275 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.273+0000 7f302effd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.274+0000 7f302effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.274+0000 7f302effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.274+0000 7f302effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.274+0000 7f302ffff640 10 monclient(hunting): handle_auth_done global_id 14297 payload 274 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.274+0000 7f302ffff640 1 -- 172.21.15.116:0/2810573428 >> v2:172.21.15.116:3300/0 conn(0x7f303006bdf0 msgr2=0x7f30300b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.274+0000 7f302ffff640 1 --2- 172.21.15.116:0/2810573428 >> v2:172.21.15.116:3300/0 conn(0x7f303006bdf0 0x7f30300b0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.275+0000 7f302ffff640 1 -- 172.21.15.116:0/2810573428 >> v1:172.21.15.116:6789/0 conn(0x7f303006ba10 legacy=0x7f30300b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.275+0000 7f302ffff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.275+0000 7f302ffff640 1 monclient: found mon.noname-b 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.275+0000 7f302ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.275+0000 7f302ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.275+0000 7f302ffff640 1 -- 172.21.15.116:0/2810573428 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303006cb90 con 0x7f30300ae400 2024-01-23T07:33:38.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.276+0000 7f302ffff640 1 --2- 172.21.15.116:0/2810573428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30300ae400 0x7f30300ae820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3028009e50 tx=0x7f302802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0e2048ea9b1095 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 1 -- 172.21.15.116:0/2810573428 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302802c9e0 con 0x7f30300ae400 2024-01-23T07:33:38.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: dump: 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.281 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 1 -- 172.21.15.116:0/2810573428 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302802cb40 con 0x7f30300ae400 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 1 -- 172.21.15.116:0/2810573428 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280343f0 con 0x7f30300ae400 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f3035c2a640 5 monclient: authenticate success, global_id 14297 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f3035c2a640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f3035c2a640 4 set_mon_vals no callback set 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.280+0000 7f302e7fc640 10 monclient: dump: 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.282 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.283 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.283 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.283 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.283 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 10 monclient: shutdown 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 -- 172.21.15.116:0/2810573428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30300ae400 msgr2=0x7f30300ae820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2810573428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30300ae400 0x7f30300ae820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3028009e50 tx=0x7f302802be40 comp rx=0 tx=0).stop 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 -- 172.21.15.116:0/2810573428 shutdown_connections 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2810573428 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f30300ae400 0x7f30300ae820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2810573428 >> v2:172.21.15.116:3300/0 conn(0x7f303006bdf0 0x7f30300b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 -- 172.21.15.116:0/2810573428 >> 172.21.15.116:0/2810573428 conn(0x7f30300b5c70 msgr2=0x7f30300b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 -- 172.21.15.116:0/2810573428 shutdown_connections 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 1 -- 172.21.15.116:0/2810573428 wait complete. 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.281+0000 7f3035c2a640 10 monclient: monmap: 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 librados: starting msgr at 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 librados: starting objecter 2024-01-23T07:33:38.288 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 Processor -- start 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 -- start start 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 librados: setting wanted keys 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 librados: calling monclient init 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 10 monclient: init 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f303006ba10 0x7f3030140c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 10 monclient(hunting): picked mon.noname-c con 0x7f303006ba10 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.282+0000 7f3035c2a640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f303006bdf0 0x7f30301cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 10 monclient(hunting): picked mon.noname-b con 0x7f303006bdf0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30300ae400 0x7f30301da880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 10 monclient(hunting): picked mon.noname-a con 0x7f30300ae400 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30301daf30 con 0x7f30300ae400 2024-01-23T07:33:38.289 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30301db3c0 con 0x7f303006bdf0 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30301db580 con 0x7f303006ba10 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f3035c2a640 10 monclient(hunting): authenticate will time out at 2425.641270s 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30300ae400 0x7f30301da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302f7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f303006ba10 0x7f3030140c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302f7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f303006ba10 0x7f3030140c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36522/0 (socket says 172.21.15.116:36522) 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302f7fe640 1 -- 172.21.15.116:0/2536840879 learned_addr learned my addr 172.21.15.116:0/2536840879 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302f7fe640 10 monclient(hunting): get_auth_request con 0x7f303006ba10 auth_method 0 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302f7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302effd640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f303006bdf0 0x7f30301cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302ffff640 10 monclient(hunting): get_auth_request con 0x7f30300ae400 auth_method 0 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302ffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.283+0000 7f302ffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302effd640 10 monclient(hunting): get_auth_request con 0x7f303006bdf0 auth_method 0 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302effd640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302effd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.284+0000 7f302effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 10 monclient(hunting): handle_auth_done global_id 14300 payload 824 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 1 -- 172.21.15.116:0/2536840879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f303006bdf0 msgr2=0x7f30301cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f303006bdf0 0x7f30301cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 1 -- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30300ae400 msgr2=0x7f30301da880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30300ae400 0x7f30301da880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 1 monclient: found mon.noname-c 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.287+0000 7f302f7fe640 1 -- 172.21.15.116:0/2536840879 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009b30 con 0x7f303006ba10 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.289+0000 7f302f7fe640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f303006ba10 0x7f3030140c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f302000c400 tx=0x7f302000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.289+0000 7f3017fff640 10 client.?.objecter ms_handle_connect 0x7f303006ba10 2024-01-23T07:33:38.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.289+0000 7f3017fff640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 1 -- 172.21.15.116:0/2536840879 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30200052d0 con 0x7f303006ba10 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: dump: 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.295 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 1 -- 172.21.15.116:0/2536840879 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3020005450 con 0x7f303006ba10 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 5 monclient: authenticate success, global_id 14300 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 1 -- 172.21.15.116:0/2536840879 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020007260 con 0x7f303006ba10 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3017fff640 10 monclient: dump: 2024-01-23T07:33:38.296 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 10 monclient: _renew_subs 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f302dffb640 4 set_mon_vals no callback set 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30301d7380 con 0x7f303006ba10 2024-01-23T07:33:38.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 10 client.14300.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 10 monclient: _renew_subs 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30301d7840 con 0x7f303006ba10 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.293+0000 7f3035c2a640 1 librados: init done 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.294+0000 7f3035c2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.294+0000 7f3035c2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.294+0000 7f3035c2a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.294+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30301db7a0 con 0x7f303006ba10 2024-01-23T07:33:38.341 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.446+0000 7f93c4f3b640 10 monclient: get_monmap_and_config 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.446+0000 7f93c4f3b640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.446+0000 7f93c4f3b640 10 monclient: monmap: 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:38.447986+0000 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:38.447986+0000 2024-01-23T07:33:38.447 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.448 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.448 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:38.448 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:38.448 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:38.448 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:38.448 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:38.448 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.447+0000 7f93c4f3b640 1 Processor -- start 2024-01-23T07:33:38.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.447+0000 7f93c4f3b640 1 -- start start 2024-01-23T07:33:38.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.447+0000 7f93c4f3b640 10 monclient: init 2024-01-23T07:33:38.449 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient: _add_conns ranks=[1,0,2,3,4] 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f93c00a96e0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f93c013faa0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c00b1850 0x7f93c0145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient(hunting): picked mon.noname-b con 0x7f93c00b1850 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00aac10 con 0x7f93c013faa0 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c00a9ac0 con 0x7f93c00a96e0 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00a9e00 con 0x7f93c00b1850 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93c4f3b640 10 monclient(hunting): authenticate will time out at 2425.806486s 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93b7fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f93c013faa0 0x7f93c0145600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:37398/0 (socket says 172.21.15.116:37398) 2024-01-23T07:33:38.450 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.448+0000 7f93b7fff640 1 -- 172.21.15.116:0/3497310262 learned_addr learned my addr 172.21.15.116:0/3497310262 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:38.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.452+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828558914 0 0) 0x7f93c00aac10 con 0x7f93c013faa0 2024-01-23T07:33:38.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.452+0000 7f93bdd9b640 10 monclient(hunting): _negotiate 2024-01-23T07:33:38.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.452+0000 7f93bdd9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.452+0000 7f93bdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.452+0000 7f93bdd9b640 10 monclient(hunting): my global_id is 4404 2024-01-23T07:33:38.452 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.452+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93ac003520 con 0x7f93c013faa0 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2695739030 0 0) 0x7f93ac003520 con 0x7f93c013faa0 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c00b1850 msgr2=0x7f93c0145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c00b1850 0x7f93c0145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 >> v1:172.21.15.173:6789/0 conn(0x7f93c00a96e0 legacy=0x7f93c013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 monclient: found mon.noname-a-legacy 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.116:6789/0 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00aae80 con 0x7f93c013faa0 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.458 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4041568432 0 0) 0x7f93a80017f0 con 0x7f93c013faa0 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: dump: 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.459 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] but i'm connected to v1:172.21.15.116:6789/0, reconnecting 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 >> v1:172.21.15.116:6789/0 conn(0x7f93c013faa0 legacy=0x7f93c0145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93ac0039a0 0x7f93ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): picked mon.a con 0x7f93ac0039a0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): picked mon.b con 0x7f93ac0047c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c00b1850 0x7f93ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): picked mon.c con 0x7f93c00b1850 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.460 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c00a9e00 con 0x7f93ac0039a0 2024-01-23T07:33:38.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac005530 con 0x7f93ac0047c0 2024-01-23T07:33:38.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac00bec0 con 0x7f93c00b1850 2024-01-23T07:33:38.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.461 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.457+0000 7f93bdd9b640 10 monclient(hunting): _finish_auth 0 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.458+0000 7f93be59c640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93ac0039a0 0x7f93ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.458+0000 7f93b7fff640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93b7fff640 10 monclient(hunting): get_auth_request con 0x7f93ac0047c0 auth_method 0 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93b7fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93b7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93be59c640 10 monclient(hunting): get_auth_request con 0x7f93ac0039a0 auth_method 0 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93be59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93be59c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93be59c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T07:33:38.463 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.459+0000 7f93b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.460+0000 7f93be59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.460+0000 7f93be59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.460+0000 7f93be59c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 10 monclient(hunting): handle_auth_done global_id 4404 payload 293 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 1 -- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c00b1850 msgr2=0x7f93ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c00b1850 0x7f93ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 1 -- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93ac0039a0 msgr2=0x7f93ac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93ac0039a0 0x7f93ac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 1 monclient: found mon.b 2024-01-23T07:33:38.464 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 1 -- 172.21.15.116:0/3497310262 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac003520 con 0x7f93ac0047c0 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93c4f3b640 5 monclient: authenticate success, global_id 4404 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.461+0000 7f93c4f3b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:38.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.463+0000 7f93b7fff640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93ac004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c0e0 tx=0x7f93ac0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7937c054118a58dd server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8007270 con 0x7f93ac0047c0 2024-01-23T07:33:38.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:38.467 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 10 monclient: dump: 2024-01-23T07:33:38.467 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.467 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a80073d0 con 0x7f93ac0047c0 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 1 -- 172.21.15.116:0/3497310262 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a802c7d0 con 0x7f93ac0047c0 2024-01-23T07:33:38.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 4 set_mon_vals no callback set 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bdd9b640 10 monclient: dump: 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.469 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 10 monclient: shutdown 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 1 -- 172.21.15.116:0/3497310262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 msgr2=0x7f93ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 1 --2- 172.21.15.116:0/3497310262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93ac004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c0e0 tx=0x7f93ac0057f0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93bed9d640 1 -- 172.21.15.116:0/3497310262 reap_dead start 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 1 -- 172.21.15.116:0/3497310262 shutdown_connections 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.467+0000 7f93c4f3b640 1 -- 172.21.15.116:0/3497310262 >> 172.21.15.116:0/3497310262 conn(0x7f93c00b7bb0 msgr2=0x7f93c00b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.468+0000 7f93c4f3b640 1 -- 172.21.15.116:0/3497310262 shutdown_connections 2024-01-23T07:33:38.473 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.468+0000 7f93c4f3b640 1 -- 172.21.15.116:0/3497310262 wait complete. 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.468+0000 7f93c4f3b640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.468+0000 7f93c4f3b640 10 monclient: monmap: 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 librados: starting msgr at 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 librados: starting objecter 2024-01-23T07:33:38.474 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 Processor -- start 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 -- start start 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 librados: setting wanted keys 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 librados: calling monclient init 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient: init 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93c01daed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): picked mon.noname-b con 0x7f93ac0047c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93c00b0b10 0x7f93c01db410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): picked mon.noname-a con 0x7f93c00b0b10 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c0138c70 0x7f93c01390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): picked mon.noname-c con 0x7f93c0138c70 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01dba50 con 0x7f93c00b0b10 2024-01-23T07:33:38.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c0139630 con 0x7f93ac0047c0 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c01397a0 con 0x7f93c0138c70 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.469+0000 7f93c4f3b640 10 monclient(hunting): authenticate will time out at 2425.827981s 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93b7fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93c00b0b10 0x7f93c01db410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93be59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93c01daed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93be59c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93c01daed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:38018/0 (socket says 172.21.15.116:38018) 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93be59c640 1 -- 172.21.15.116:0/49064700 learned_addr learned my addr 172.21.15.116:0/49064700 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93be59c640 10 monclient(hunting): get_auth_request con 0x7f93ac0047c0 auth_method 0 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93be59c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93be59c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93be59c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93b7fff640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93c00b0b10 0x7f93c01db410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49094/0 (socket says 172.21.15.116:49094) 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93b7fff640 10 monclient(hunting): get_auth_request con 0x7f93c00b0b10 auth_method 0 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93b7fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.470+0000 7f93b7fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.471+0000 7f93be59c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.471+0000 7f93be59c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.471+0000 7f93be59c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.471+0000 7f93b7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.471+0000 7f93b7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.471+0000 7f93b7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 10 monclient(hunting): handle_auth_done global_id 4390 payload 824 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 1 -- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c0138c70 msgr2=0x7f93c01390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c0138c70 0x7f93c01390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 1 -- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93c00b0b10 msgr2=0x7f93c01db410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93c00b0b10 0x7f93c01db410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 1 monclient: found mon.noname-b 2024-01-23T07:33:38.478 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:38.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.473+0000 7f93be59c640 1 -- 172.21.15.116:0/49064700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c00ac0d0 con 0x7f93ac0047c0 2024-01-23T07:33:38.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.475+0000 7f93be59c640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93c01daed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93b000f620 tx=0x7f93b000fae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.475+0000 7f93b6ffd640 10 client.?.objecter ms_handle_connect 0x7f93ac0047c0 2024-01-23T07:33:38.479 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.475+0000 7f93b6ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 1 -- 172.21.15.116:0/49064700 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b00052e0 con 0x7f93ac0047c0 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: dump: 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.480 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 1 -- 172.21.15.116:0/49064700 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b0005440 con 0x7f93ac0047c0 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 1 -- 172.21.15.116:0/49064700 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0003830 con 0x7f93ac0047c0 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 5 monclient: authenticate success, global_id 4390 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 10 monclient: _renew_subs 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c00ac2c0 con 0x7f93ac0047c0 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93bcd99640 4 set_mon_vals no callback set 2024-01-23T07:33:38.481 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93b6ffd640 10 monclient: dump: 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 10 client.4390.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 10 monclient: _renew_subs 2024-01-23T07:33:38.482 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:38.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c00ac7a0 con 0x7f93ac0047c0 2024-01-23T07:33:38.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.479+0000 7f93c4f3b640 1 librados: init done 2024-01-23T07:33:38.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.480+0000 7f93c4f3b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.480+0000 7f93c4f3b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.480+0000 7f93c4f3b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:38.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.480+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c00abeb0 con 0x7f93ac0047c0 2024-01-23T07:33:38.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.498+0000 7f93b6ffd640 1 -- 172.21.15.116:0/49064700 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f93b0003990 con 0x7f93ac0047c0 2024-01-23T07:33:38.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.499+0000 7f93b6ffd640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f93a006c8e0 0x7f93a006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.499 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.499+0000 7f93b7fff640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f93a006c8e0 0x7f93a006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.499+0000 7f93b7fff640 10 monclient: get_auth_request con 0x7f93a006c8e0 auth_method 0 2024-01-23T07:33:38.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.499+0000 7f93b6ffd640 10 client.4390.objecter ms_handle_connect 0x7f93a006c8e0 2024-01-23T07:33:38.500 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.499+0000 7f93b7fff640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f93a006c8e0 0x7f93a006eda0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93a8034000 tx=0x7f93a8009030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.501+0000 7f93b6ffd640 1 -- 172.21.15.116:0/49064700 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f93b0059200 con 0x7f93ac0047c0 2024-01-23T07:33:38.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.501+0000 7f93b6ffd640 10 client.4390.objecter ms_dispatch 0x7f93c0000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:38.501 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.501+0000 7f93b6ffd640 3 client.4390.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:38.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.501+0000 7f93b6ffd640 3 client.4390.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:38.502 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.501+0000 7f93b6ffd640 20 client.4390.objecter dump_active .. 0 homeless 2024-01-23T07:33:38.530 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-23T07:33:38.544 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-23T07:33:38.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.551+0000 7f3017fff640 1 -- 172.21.15.116:0/2536840879 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f30200073c0 con 0x7f303006ba10 2024-01-23T07:33:38.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.552+0000 7f3017fff640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f301c06c8b0 0x7f301c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.552+0000 7f302effd640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f301c06c8b0 0x7f301c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.552+0000 7f302effd640 10 monclient: get_auth_request con 0x7f301c06c8b0 auth_method 0 2024-01-23T07:33:38.553 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.552+0000 7f3017fff640 10 client.14300.objecter ms_handle_connect 0x7f301c06c8b0 2024-01-23T07:33:38.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.552+0000 7f302effd640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f301c06c8b0 0x7f301c06ed70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30301d8440 tx=0x7f3024009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.566+0000 7f3017fff640 1 -- 172.21.15.116:0/2536840879 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3020007670 con 0x7f303006ba10 2024-01-23T07:33:38.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.566+0000 7f3017fff640 10 client.14300.objecter ms_dispatch 0x7f3030000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:38.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.567+0000 7f3017fff640 3 client.14300.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:38.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.567+0000 7f3017fff640 3 client.14300.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:38.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.567+0000 7f3017fff640 20 client.14300.objecter dump_active .. 0 homeless 2024-01-23T07:33:38.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.567+0000 7f3017fff640 1 -- 172.21.15.116:0/2536840879 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f30200541a0 con 0x7f303006ba10 2024-01-23T07:33:38.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.567+0000 7f3017fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.567+0000 7f3017fff640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:38.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.641+0000 7f3333c59640 10 monclient: get_monmap_and_config 2024-01-23T07:33:38.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.641+0000 7f3333c59640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.641+0000 7f3333c59640 10 monclient: monmap: 2024-01-23T07:33:38.642 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.642 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.642 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:38.642664+0000 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:38.642664+0000 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 1 Processor -- start 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 1 -- start start 2024-01-23T07:33:38.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 10 monclient: init 2024-01-23T07:33:38.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 10 monclient: _add_conns ranks=[3,1,4,2,0] 2024-01-23T07:33:38.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f332c0a96e0 0x7f332c0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 10 monclient(hunting): picked mon.noname-a con 0x7f332c0a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.642+0000 7f3333c59640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f332c13f390 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f332c145600 0x7f332c145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 10 monclient(hunting): picked mon.noname-c con 0x7f332c145600 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f332c0aac10 con 0x7f332c13f390 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0a9e00 con 0x7f332c0a96e0 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f332c0a9ac0 con 0x7f332c145600 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.643+0000 7f3333c59640 10 monclient(hunting): authenticate will time out at 2426.001248s 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.675+0000 7ffa8bab1640 10 monclient: get_monmap_and_config 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.675+0000 7ffa8bab1640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.675+0000 7ffa8bab1640 10 monclient: monmap: 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:38.676789+0000 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:38.676789+0000 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:38.676 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:38.677 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:38.677 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:38.677 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.676+0000 7ffa8bab1640 1 Processor -- start 2024-01-23T07:33:38.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.676+0000 7ffa8bab1640 1 -- start start 2024-01-23T07:33:38.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.676+0000 7ffa8bab1640 10 monclient: init 2024-01-23T07:33:38.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.676+0000 7ffa8bab1640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.678 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.676+0000 7ffa8bab1640 10 monclient: _add_conns ranks=[0,4,2,3,1] 2024-01-23T07:33:38.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.676+0000 7ffa8bab1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ffa840a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:38.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.676+0000 7ffa8bab1640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7ffa8413faa0 0x7ffa840b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 10 monclient(hunting): picked mon.noname-c con 0x7ffa8413faa0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:38.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa84145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.679 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 10 monclient(hunting): picked mon.noname-b con 0x7ffa84145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840aac10 con 0x7ffa840a96e0 2024-01-23T07:33:38.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa840a9e00 con 0x7ffa8413faa0 2024-01-23T07:33:38.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840a9ac0 con 0x7ffa84145600 2024-01-23T07:33:38.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.677+0000 7ffa8bab1640 10 monclient(hunting): authenticate will time out at 2426.035337s 2024-01-23T07:33:38.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.681+0000 7ffa8a04e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa84145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa84145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36564/0 (socket says 172.21.15.116:36564) 2024-01-23T07:33:38.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 1 -- 172.21.15.116:0/2845485484 learned_addr learned my addr 172.21.15.116:0/2845485484 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:38.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 10 monclient(hunting): get_auth_request con 0x7ffa84145600 auth_method 0 2024-01-23T07:33:38.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.683 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.682+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_done global_id 14303 payload 274 2024-01-23T07:33:38.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 1 -- 172.21.15.116:0/2845485484 >> v2:172.21.15.173:3300/0 conn(0x7ffa8413faa0 msgr2=0x7ffa840b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 1 --2- 172.21.15.116:0/2845485484 >> v2:172.21.15.173:3300/0 conn(0x7ffa8413faa0 0x7ffa840b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 1 -- 172.21.15.116:0/2845485484 >> v1:172.21.15.116:6789/0 conn(0x7ffa840a96e0 legacy=0x7ffa8413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.684 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 1 monclient: found mon.noname-b 2024-01-23T07:33:38.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.685 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.684+0000 7ffa8a04e640 1 -- 172.21.15.116:0/2845485484 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840aae80 con 0x7ffa84145600 2024-01-23T07:33:38.686 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.686+0000 7ffa8a04e640 1 --2- 172.21.15.116:0/2845485484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa84145a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009e50 tx=0x7ffa7c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa60423881b8c9c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.689 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 1 -- 172.21.15.116:0/2845485484 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c02ca70 con 0x7ffa84145600 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: dump: 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.690 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 1 -- 172.21.15.116:0/2845485484 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c02cbd0 con 0x7ffa84145600 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8bab1640 5 monclient: authenticate success, global_id 14303 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 1 -- 172.21.15.116:0/2845485484 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c0343f0 con 0x7ffa84145600 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8bab1640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8bab1640 4 set_mon_vals no callback set 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.689+0000 7ffa8884b640 10 monclient: dump: 2024-01-23T07:33:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.692 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 10 monclient: shutdown 2024-01-23T07:33:38.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 -- 172.21.15.116:0/2845485484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 msgr2=0x7ffa84145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/2845485484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa84145a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009e50 tx=0x7ffa7c02bed0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 -- 172.21.15.116:0/2845485484 shutdown_connections 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/2845485484 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa84145a90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/2845485484 >> v2:172.21.15.173:3300/0 conn(0x7ffa8413faa0 0x7ffa840b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 -- 172.21.15.116:0/2845485484 >> 172.21.15.116:0/2845485484 conn(0x7ffa840b7bb0 msgr2=0x7ffa840b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 -- 172.21.15.116:0/2845485484 shutdown_connections 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.690+0000 7ffa8bab1640 1 -- 172.21.15.116:0/2845485484 wait complete. 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.691+0000 7ffa8bab1640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.691+0000 7ffa8bab1640 10 monclient: monmap: 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.691+0000 7ffa8bab1640 1 librados: starting msgr at 2024-01-23T07:33:38.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.691+0000 7f33319f5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f332c0a96e0 0x7f332c0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.691+0000 7ffa8bab1640 1 librados: starting objecter 2024-01-23T07:33:38.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.691+0000 7ffa8bab1640 1 Processor -- start 2024-01-23T07:33:38.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 -- start start 2024-01-23T07:33:38.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 librados: setting wanted keys 2024-01-23T07:33:38.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 librados: calling monclient init 2024-01-23T07:33:38.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient: init 2024-01-23T07:33:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7f33319f5640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f332c0a96e0 0x7f332c0b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49096/0 (socket says 172.21.15.116:49096) 2024-01-23T07:33:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7f33319f5640 1 -- 172.21.15.116:0/2089886471 learned_addr learned my addr 172.21.15.116:0/2089886471 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7f33319f5640 10 monclient(hunting): get_auth_request con 0x7f332c0a96e0 auth_method 0 2024-01-23T07:33:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7f33319f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7f33319f5640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7f33319f5640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:38.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa840a96e0 0x7ffa84140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): picked mon.noname-b con 0x7ffa840a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa8413faa0 0x7ffa84131c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): picked mon.noname-a con 0x7ffa8413faa0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa841321b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): picked mon.noname-c con 0x7ffa84145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84142010 con 0x7ffa8413faa0 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa84142260 con 0x7ffa840a96e0 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841326f0 con 0x7ffa84145600 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.692+0000 7ffa8bab1640 10 monclient(hunting): authenticate will time out at 2426.051110s 2024-01-23T07:33:38.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.693+0000 7f33319f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.693+0000 7f33319f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.693+0000 7f33319f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 10 monclient(hunting): handle_auth_done global_id 4410 payload 274 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 1 -- 172.21.15.116:0/2089886471 >> v2:172.21.15.173:3300/0 conn(0x7f332c145600 msgr2=0x7f332c145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 1 --2- 172.21.15.116:0/2089886471 >> v2:172.21.15.173:3300/0 conn(0x7f332c145600 0x7f332c145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 1 -- 172.21.15.116:0/2089886471 >> v1:172.21.15.173:6789/0 conn(0x7f332c13f390 legacy=0x7f332c13f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 1 monclient: found mon.noname-a 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.697+0000 7f33319f5640 1 -- 172.21.15.116:0/2089886471 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0aae80 con 0x7f332c0a96e0 2024-01-23T07:33:38.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.700+0000 7f33319f5640 1 --2- 172.21.15.116:0/2089886471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c0a96e0 0x7f332c0b1850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f332c074ae0 tx=0x7f332802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e648c472cd931ef2 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.700+0000 7ffa8904c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa8413faa0 0x7ffa84131c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa841321b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8904c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa8413faa0 0x7ffa84131c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49102/0 (socket says 172.21.15.116:49102) 2024-01-23T07:33:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8904c640 1 -- 172.21.15.116:0/1347441889 learned_addr learned my addr 172.21.15.116:0/1347441889 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8904c640 10 monclient(hunting): get_auth_request con 0x7ffa8413faa0 auth_method 0 2024-01-23T07:33:38.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8904c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8904c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8904c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 10 monclient(hunting): get_auth_request con 0x7ffa84145600 auth_method 0 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.701+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.703+0000 7ffa8904c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.703+0000 7ffa8904c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.703+0000 7ffa8904c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 10 monclient(hunting): handle_auth_done global_id 14306 payload 824 2024-01-23T07:33:38.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 1 -- 172.21.15.116:0/1347441889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa840a96e0 msgr2=0x7ffa84140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa840a96e0 0x7ffa84140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 1 -- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa8413faa0 msgr2=0x7ffa84131c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa8413faa0 0x7ffa84131c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 1 monclient: found mon.noname-c 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.704+0000 7ffa8a04e640 1 -- 172.21.15.116:0/1347441889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c009b30 con 0x7ffa84145600 2024-01-23T07:33:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.706+0000 7ffa8a04e640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa841321b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c032000 tx=0x7ffa7c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.706+0000 7ffa7a7fc640 10 client.?.objecter ms_handle_connect 0x7ffa84145600 2024-01-23T07:33:38.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.706+0000 7ffa7a7fc640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.709+0000 7ffa7a7fc640 1 -- 172.21.15.116:0/1347441889 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c03e450 con 0x7ffa84145600 2024-01-23T07:33:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.709+0000 7ffa7a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.709+0000 7ffa7a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.709+0000 7ffa7a7fc640 10 monclient: dump: 2024-01-23T07:33:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.711 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 1 -- 172.21.15.116:0/1347441889 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7c03e5b0 con 0x7ffa84145600 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 5 monclient: authenticate success, global_id 14306 2024-01-23T07:33:38.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 10 monclient: _renew_subs 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa84142e40 con 0x7ffa84145600 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 1 -- 172.21.15.116:0/1347441889 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7c03e760 con 0x7ffa84145600 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7a7fc640 10 monclient: dump: 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.713 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa7bfff640 4 set_mon_vals no callback set 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 10 client.14306.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 10 monclient: _renew_subs 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa84142b40 con 0x7ffa84145600 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.710+0000 7ffa8bab1640 1 librados: init done 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.711+0000 7ffa8bab1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.711+0000 7ffa8bab1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.711+0000 7ffa8bab1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.711+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa84067d70 con 0x7ffa84145600 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f33309f3640 1 -- 172.21.15.116:0/2089886471 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328031870 con 0x7f332c0a96e0 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f33309f3640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f33309f3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f33309f3640 10 monclient: dump: 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.719 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f33309f3640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f33309f3640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f33309f3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f3333c59640 5 monclient: authenticate success, global_id 4410 2024-01-23T07:33:38.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.719+0000 7f3333c59640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:38.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.734+0000 7ffa7a7fc640 1 -- 172.21.15.116:0/1347441889 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7ffa7c03e8c0 con 0x7ffa84145600 2024-01-23T07:33:38.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.734+0000 7f93b6ffd640 1 -- 172.21.15.116:0/49064700 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f93b0054e40 con 0x7f93ac0047c0 2024-01-23T07:33:38.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.734+0000 7f93b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.734+0000 7f93b6ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:38.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.735+0000 7ffa7a7fc640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ffa6806c860 0x7ffa6806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.735+0000 7ffa8984d640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ffa6806c860 0x7ffa6806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.735+0000 7ffa8984d640 10 monclient: get_auth_request con 0x7ffa6806c860 auth_method 0 2024-01-23T07:33:38.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.735+0000 7ffa7a7fc640 10 client.14306.objecter ms_handle_connect 0x7ffa6806c860 2024-01-23T07:33:38.736 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.735+0000 7ffa8984d640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ffa6806c860 0x7ffa6806ed20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa80001560 tx=0x7ffa80007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.739+0000 7ffa7a7fc640 1 -- 172.21.15.116:0/1347441889 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffa7c07bde0 con 0x7ffa84145600 2024-01-23T07:33:38.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.739+0000 7ffa7a7fc640 10 client.14306.objecter ms_dispatch 0x7ffa84000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:38.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.739+0000 7ffa7a7fc640 3 client.14306.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:38.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.739+0000 7ffa7a7fc640 3 client.14306.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:38.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.739+0000 7ffa7a7fc640 20 client.14306.objecter dump_active .. 0 homeless 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.741+0000 7f33309f3640 1 -- 172.21.15.116:0/2089886471 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33280319d0 con 0x7f332c0a96e0 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.741+0000 7f33309f3640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.741+0000 7f33309f3640 1 -- 172.21.15.116:0/2089886471 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328031d60 con 0x7f332c0a96e0 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.741+0000 7f33309f3640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.741+0000 7f33309f3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.741+0000 7f33309f3640 10 monclient: dump: 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.742 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.741+0000 7f3333c59640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:38.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 4 set_mon_vals no callback set 2024-01-23T07:33:38.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 10 monclient: shutdown 2024-01-23T07:33:38.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:38.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 -- 172.21.15.116:0/2089886471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c0a96e0 msgr2=0x7f332c0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 --2- 172.21.15.116:0/2089886471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c0a96e0 0x7f332c0b1850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f332c074ae0 tx=0x7f332802b910 comp rx=0 tx=0).stop 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 -- 172.21.15.116:0/2089886471 shutdown_connections 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 --2- 172.21.15.116:0/2089886471 >> v2:172.21.15.173:3300/0 conn(0x7f332c145600 0x7f332c145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 --2- 172.21.15.116:0/2089886471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c0a96e0 0x7f332c0b1850 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 -- 172.21.15.116:0/2089886471 >> 172.21.15.116:0/2089886471 conn(0x7f332c0b7bb0 msgr2=0x7f332c0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 -- 172.21.15.116:0/2089886471 shutdown_connections 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.742+0000 7f3333c59640 1 -- 172.21.15.116:0/2089886471 wait complete. 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.743+0000 7f3333c59640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.743+0000 7f3333c59640 10 monclient: monmap: 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:38.746 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 1 librados: starting msgr at 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 1 librados: starting objecter 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 1 Processor -- start 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 1 -- start start 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 1 librados: setting wanted keys 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 1 librados: calling monclient init 2024-01-23T07:33:38.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 10 monclient: init 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.744+0000 7f3333c59640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f332c0a96e0 0x7f332c144a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): picked mon.noname-c con 0x7f332c0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f332c13f390 0x7f332c138000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): picked mon.noname-b con 0x7f332c13f390 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c145600 0x7f332c136350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): picked mon.noname-a con 0x7f332c145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c138540 con 0x7f332c145600 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332c137900 con 0x7f332c13f390 2024-01-23T07:33:38.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f332c0b7770 con 0x7f332c0a96e0 2024-01-23T07:33:38.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f3333c59640 10 monclient(hunting): authenticate will time out at 2426.103350s 2024-01-23T07:33:38.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.745+0000 7f33321f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c145600 0x7f332c136350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c145600 0x7f332c136350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49108/0 (socket says 172.21.15.116:49108) 2024-01-23T07:33:38.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 1 -- 172.21.15.116:0/1535327852 learned_addr learned my addr 172.21.15.116:0/1535327852 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:38.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 10 monclient(hunting): get_auth_request con 0x7f332c145600 auth_method 0 2024-01-23T07:33:38.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.746+0000 7f33321f6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.748+0000 7f33311f4640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f332c13f390 0x7f332c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.748+0000 7f33311f4640 10 monclient(hunting): get_auth_request con 0x7f332c13f390 auth_method 0 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.748+0000 7f33311f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.748+0000 7f33311f4640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.748+0000 7f33311f4640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 10 monclient(hunting): handle_auth_done global_id 4416 payload 824 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 1 -- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f332c0a96e0 msgr2=0x7f332c144a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f332c0a96e0 0x7f332c144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 1 -- 172.21.15.116:0/1535327852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f332c13f390 msgr2=0x7f332c138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f332c13f390 0x7f332c138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 10 monclient: _finish_hunting 0 2024-01-23T07:33:38.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 1 monclient: found mon.noname-a 2024-01-23T07:33:38.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:38.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T07:33:38.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.749+0000 7f33321f6640 1 -- 172.21.15.116:0/1535327852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33280094d0 con 0x7f332c145600 2024-01-23T07:33:38.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.751+0000 7f33321f6640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c145600 0x7f332c136350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f332400b9e0 tx=0x7f332400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.751+0000 7f33227fc640 10 client.?.objecter ms_handle_connect 0x7f332c145600 2024-01-23T07:33:38.752 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.751+0000 7f33227fc640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:38.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 1 -- 172.21.15.116:0/1535327852 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332400caa0 con 0x7f332c145600 2024-01-23T07:33:38.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T07:33:38.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: dump: 2024-01-23T07:33:38.755 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: _finish_auth 0 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: _check_auth_tickets 2024-01-23T07:33:38.756 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 1 -- 172.21.15.116:0/1535327852 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332400cc20 con 0x7f332c145600 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 1 -- 172.21.15.116:0/1535327852 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324014440 con 0x7f332c145600 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f33227fc640 10 monclient: dump: 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.757 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:38.758 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:38.758 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:38.758 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.755+0000 7f3323fff640 4 set_mon_vals no callback set 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 5 monclient: authenticate success, global_id 4416 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 monclient: _renew_subs 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332c0b7070 con 0x7f332c145600 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 client.4416.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 monclient: _renew_subs 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f332c136a70 con 0x7f332c145600 2024-01-23T07:33:38.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 1 librados: init done 2024-01-23T07:33:38.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:38.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:38.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.756+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332c067d70 con 0x7f332c145600 2024-01-23T07:33:38.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.776+0000 7f33227fc640 1 -- 172.21.15.116:0/1535327852 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f332401d3b0 con 0x7f332c145600 2024-01-23T07:33:38.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.776+0000 7f33227fc640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f331006c8b0 0x7f331006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.776+0000 7f33319f5640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f331006c8b0 0x7f331006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:38.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.776+0000 7f33319f5640 10 monclient: get_auth_request con 0x7f331006c8b0 auth_method 0 2024-01-23T07:33:38.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.777+0000 7f33319f5640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f331006c8b0 0x7f331006ed70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3328036000 tx=0x7f3328030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:38.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.777+0000 7f33227fc640 10 client.4416.objecter ms_handle_connect 0x7f331006c8b0 2024-01-23T07:33:38.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.779+0000 7f33227fc640 1 -- 172.21.15.116:0/1535327852 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3324058c50 con 0x7f332c145600 2024-01-23T07:33:38.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.779+0000 7f33227fc640 10 client.4416.objecter ms_dispatch 0x7f332c000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:38.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.779+0000 7f33227fc640 3 client.4416.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:38.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.779+0000 7f33227fc640 3 client.4416.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:38.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.779+0000 7f33227fc640 20 client.4416.objecter dump_active .. 0 homeless 2024-01-23T07:33:38.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-23T07:33:38.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.801+0000 7f3035c2a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:38.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.801+0000 7f3035c2a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:38.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.801+0000 7f3035c2a640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:38.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.801+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f303004ea10 con 0x7f303006ba10 2024-01-23T07:33:38.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.909+0000 7f6a5e8df640 10 monclient: get_monmap_and_config 2024-01-23T07:33:38.909 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.909+0000 7f6a5e8df640 10 monclient: build_initial_monmap 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.909+0000 7f6a5e8df640 10 monclient: monmap: 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:38.910590+0000 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:38.910590+0000 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:38.910 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:38.911 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.910+0000 7f6a5e8df640 1 Processor -- start 2024-01-23T07:33:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.910+0000 7f6a5e8df640 1 -- start start 2024-01-23T07:33:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.910+0000 7f6a5e8df640 10 monclient: init 2024-01-23T07:33:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient: _add_conns ranks=[3,0,2,4,1] 2024-01-23T07:33:38.912 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f6a580a96e0 0x7f6a580b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient(hunting): picked mon.noname-a con 0x7f6a580a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6a5813f390 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient(hunting): picked mon.noname-b con 0x7f6a58145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a580aac10 con 0x7f6a5813f390 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a580a9e00 con 0x7f6a580a96e0 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580a9ac0 con 0x7f6a58145600 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:38.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.911+0000 7f6a5e8df640 10 monclient(hunting): authenticate will time out at 2426.269580s 2024-01-23T07:33:38.922 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-23T07:33:38.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.923+0000 7f93c4f3b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:38.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.923+0000 7f93c4f3b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:38.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.923+0000 7f93c4f3b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:38.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.923+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f93c0067d70 con 0x7f93ac0047c0 2024-01-23T07:33:38.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.926+0000 7f93b6ffd640 1 -- 172.21.15.116:0/49064700 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93b0058460 con 0x7f93ac0047c0 2024-01-23T07:33:38.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.926+0000 7f93b6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-01-23T07:33:38.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.926+0000 7f93b6ffd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:38.927 INFO:teuthology.orchestra.run.smithi116.stdout:68719476743 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 10 librados: watch_flush enter 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 10 librados: watch_flush exit 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 20 client.4390.objecter shutdown clearing up homeless session... 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 10 client.4390.objecter successfully canceled tick 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f93a006c8e0 msgr2=0x7f93a006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f93a006c8e0 0x7f93a006eda0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93a8034000 tx=0x7f93a8009030 comp rx=0 tx=0).stop 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 10 monclient: shutdown 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:38.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 msgr2=0x7f93c01daed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93c01daed0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f93b000f620 tx=0x7f93b000fae0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 shutdown_connections 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f93a006c8e0 0x7f93a006eda0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93c0138c70 0x7f93c01390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93c00b0b10 0x7f93c01db410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 --2- 172.21.15.116:0/49064700 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93ac0047c0 0x7f93c01daed0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 >> 172.21.15.116:0/49064700 conn(0x7f93c00b7bb0 msgr2=0x7f93c013cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 shutdown_connections 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 -- 172.21.15.116:0/49064700 wait complete. 2024-01-23T07:33:38.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:38.928+0000 7f93c4f3b640 1 librados: shutdown 2024-01-23T07:33:38.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476743 for osd.2 2024-01-23T07:33:38.940 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:39.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.024+0000 7ffa7a7fc640 1 -- 172.21.15.116:0/1347441889 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7ffa7c077a20 con 0x7ffa84145600 2024-01-23T07:33:39.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.024+0000 7ffa7a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.024+0000 7ffa7a7fc640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:39.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.028+0000 7f938f989640 10 monclient: get_monmap_and_config 2024-01-23T07:33:39.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.028+0000 7f938f989640 10 monclient: build_initial_monmap 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.028+0000 7f938f989640 10 monclient: monmap: 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:39.029760+0000 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:39.029760+0000 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:39.029 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:39.030 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:39.030 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:39.030 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.029+0000 7f938f989640 1 Processor -- start 2024-01-23T07:33:39.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.029+0000 7f938f989640 1 -- start start 2024-01-23T07:33:39.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.029+0000 7f938f989640 10 monclient: init 2024-01-23T07:33:39.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.029+0000 7f6a5ce7c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient: _add_conns ranks=[4,3,2,1,0] 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f93880a96e0 0x7f93880b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): picked mon.noname-c con 0x7f93880a96e0 addr v2:172.21.15.173:3300/0 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f938813f390 0x7f938813f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): picked mon.noname-a con 0x7f938813f390 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9388145600 0x7f9388145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): picked mon.noname-b con 0x7f9388145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93880a9e00 con 0x7f938813f390 2024-01-23T07:33:39.033 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93880aac10 con 0x7f93880a96e0 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938813fd30 con 0x7f9388145600 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.030+0000 7f938f989640 10 monclient(hunting): authenticate will time out at 2426.388697s 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.031+0000 7f938d725640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f93880a96e0 0x7f93880b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.031+0000 7f938d725640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f93880a96e0 0x7f93880b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:38058/0 (socket says 172.21.15.116:38058) 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.031+0000 7f938d725640 1 -- 172.21.15.116:0/3730785655 learned_addr learned my addr 172.21.15.116:0/3730785655 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.031+0000 7f938d725640 10 monclient(hunting): get_auth_request con 0x7f93880a96e0 auth_method 0 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.031+0000 7f938d725640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.034 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.031+0000 7f938d725640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.031+0000 7f938d725640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f938d725640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f938d725640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f938d725640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f6a5ce7c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58145a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36592/0 (socket says 172.21.15.116:36592) 2024-01-23T07:33:39.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/4131098912 learned_addr learned my addr 172.21.15.116:0/4131098912 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:39.035 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f6a5ce7c640 10 monclient(hunting): get_auth_request con 0x7f6a58145600 auth_method 0 2024-01-23T07:33:39.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f6a5ce7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f6a5ce7c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.032+0000 7f6a5ce7c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.033+0000 7f938d725640 10 monclient(hunting): handle_auth_done global_id 4396 payload 274 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.033+0000 7f938d725640 1 -- 172.21.15.116:0/3730785655 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9388145600 msgr2=0x7f9388145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 1 --2- 172.21.15.116:0/3730785655 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9388145600 0x7f9388145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 1 -- 172.21.15.116:0/3730785655 >> v2:172.21.15.116:3300/0 conn(0x7f938813f390 msgr2=0x7f938813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 1 --2- 172.21.15.116:0/3730785655 >> v2:172.21.15.116:3300/0 conn(0x7f938813f390 0x7f938813f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 10 monclient: _finish_hunting 0 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 1 monclient: found mon.noname-c 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f938d725640 1 -- 172.21.15.116:0/3730785655 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93880a9ac0 con 0x7f93880a96e0 2024-01-23T07:33:39.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.034+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.036+0000 7f938d725640 1 --2- 172.21.15.116:0/3730785655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93880a96e0 0x7f93880b1850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9388072ab0 tx=0x7f938402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72f14c6ab3ddde6 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.036+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_done global_id 14309 payload 274 2024-01-23T07:33:39.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.036+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/4131098912 >> v2:172.21.15.116:3300/0 conn(0x7f6a580a96e0 msgr2=0x7f6a580b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:39.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.036+0000 7f6a5ce7c640 1 --2- 172.21.15.116:0/4131098912 >> v2:172.21.15.116:3300/0 conn(0x7f6a580a96e0 0x7f6a580b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/4131098912 >> v1:172.21.15.116:6789/0 conn(0x7f6a5813f390 legacy=0x7f6a5813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:39.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f6a5ce7c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:39.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f6a5ce7c640 1 monclient: found mon.noname-b 2024-01-23T07:33:39.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f6a5ce7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:39.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f6a5ce7c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/4131098912 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a580aae80 con 0x7f6a58145600 2024-01-23T07:33:39.040 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f33227fc640 1 -- 172.21.15.116:0/1535327852 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f3324054890 con 0x7f332c145600 2024-01-23T07:33:39.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f33227fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.037+0000 7f33227fc640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:39.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.039+0000 7f6a5ce7c640 1 --2- 172.21.15.116:0/4131098912 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58145a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009e50 tx=0x7f6a5002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f9e6d99b5e1de9a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 1 -- 172.21.15.116:0/3730785655 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384031870 con 0x7f93880a96e0 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: dump: 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.043 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: _finish_auth 0 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 1 -- 172.21.15.116:0/3730785655 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93840319d0 con 0x7f93880a96e0 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f938f989640 5 monclient: authenticate success, global_id 4396 2024-01-23T07:33:39.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f938f989640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 1 -- 172.21.15.116:0/3730785655 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384031d60 con 0x7f93880a96e0 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f938f989640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f938f989640 4 set_mon_vals no callback set 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.040+0000 7f937ffff640 10 monclient: dump: 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.045 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 10 monclient: shutdown 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 1 -- 172.21.15.116:0/3730785655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93880a96e0 msgr2=0x7f93880b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 1 --2- 172.21.15.116:0/3730785655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93880a96e0 0x7f93880b1850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9388072ab0 tx=0x7f938402b910 comp rx=0 tx=0).stop 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 1 -- 172.21.15.116:0/3730785655 shutdown_connections 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 1 --2- 172.21.15.116:0/3730785655 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9388145600 0x7f9388145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 1 --2- 172.21.15.116:0/3730785655 >> v2:172.21.15.116:3300/0 conn(0x7f938813f390 0x7f938813f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 1 --2- 172.21.15.116:0/3730785655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93880a96e0 0x7f93880b1850 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.041+0000 7f938f989640 1 -- 172.21.15.116:0/3730785655 >> 172.21.15.116:0/3730785655 conn(0x7f93880b7bb0 msgr2=0x7f93880b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.042+0000 7f938f989640 1 -- 172.21.15.116:0/3730785655 shutdown_connections 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.042+0000 7f938f989640 1 -- 172.21.15.116:0/3730785655 wait complete. 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 10 monclient: build_initial_monmap 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 10 monclient: monmap: 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:39.047 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.048 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:39.048 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:39.048 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:39.048 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 1 librados: starting msgr at 2024-01-23T07:33:39.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 1 librados: starting objecter 2024-01-23T07:33:39.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 1 Processor -- start 2024-01-23T07:33:39.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 1 -- start start 2024-01-23T07:33:39.050 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 1 librados: setting wanted keys 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 1 librados: calling monclient init 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.043+0000 7f938f989640 10 monclient: init 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93880a96e0 0x7f93880b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): picked mon.noname-c con 0x7f93880a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f938813f390 0x7f9388141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): picked mon.noname-b con 0x7f938813f390 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9388145600 0x7f93881d74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): picked mon.noname-a con 0x7f9388145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.051 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93881cb4e0 con 0x7f9388145600 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9388141e80 con 0x7f938813f390 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9388141750 con 0x7f93880a96e0 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.044+0000 7f938f989640 10 monclient(hunting): authenticate will time out at 2426.403089s 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.045+0000 7f938cf24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f938813f390 0x7f9388141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.045+0000 7f938cf24640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f938813f390 0x7f9388141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:38062/0 (socket says 172.21.15.116:38062) 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.045+0000 7f938cf24640 1 -- 172.21.15.116:0/3334619579 learned_addr learned my addr 172.21.15.116:0/3334619579 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.045+0000 7f938cf24640 10 monclient(hunting): get_auth_request con 0x7f938813f390 auth_method 0 2024-01-23T07:33:39.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.045+0000 7f938cf24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.045+0000 7f938cf24640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.045+0000 7f938cf24640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.046+0000 7f938cf24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.046+0000 7f938cf24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.046+0000 7f938cf24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.047+0000 7f938df26640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9388145600 0x7f93881d74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.048+0000 7f938df26640 10 monclient(hunting): get_auth_request con 0x7f9388145600 auth_method 0 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.048+0000 7f938df26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.048+0000 7f938df26640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.048+0000 7f938df26640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.053 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.048+0000 7f938cf24640 10 monclient(hunting): handle_auth_done global_id 4399 payload 824 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.048+0000 7f938cf24640 1 -- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93880a96e0 msgr2=0x7f93880b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.048+0000 7f938cf24640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93880a96e0 0x7f93880b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.049+0000 7f938cf24640 1 -- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9388145600 msgr2=0x7f93881d74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.049+0000 7f938cf24640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9388145600 0x7f93881d74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.049+0000 7f938cf24640 10 monclient: _finish_hunting 0 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.049+0000 7f938cf24640 1 monclient: found mon.noname-b 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.049+0000 7f938cf24640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.049+0000 7f938cf24640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.049+0000 7f938cf24640 1 -- 172.21.15.116:0/3334619579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840094d0 con 0x7f938813f390 2024-01-23T07:33:39.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.051+0000 7f938cf24640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f938813f390 0x7f9388141210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f937800b4a0 tx=0x7f937800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.051+0000 7f937dffb640 10 client.?.objecter ms_handle_connect 0x7f938813f390 2024-01-23T07:33:39.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.051+0000 7f937dffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:39.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 1 -- 172.21.15.116:0/4131098912 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5002ca70 con 0x7f6a58145600 2024-01-23T07:33:39.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:39.057 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: dump: 2024-01-23T07:33:39.057 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.057 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.057 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.057 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: _finish_auth 0 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 1 -- 172.21.15.116:0/4131098912 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5002cbd0 con 0x7f6a58145600 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:39.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a5e8df640 5 monclient: authenticate success, global_id 14309 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a5e8df640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a5e8df640 4 set_mon_vals no callback set 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 1 -- 172.21.15.116:0/4131098912 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a500343f0 con 0x7f6a58145600 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.052+0000 7f6a56ffd640 10 monclient: dump: 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.059 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.060 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.060 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.060 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.060 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f3017fff640 1 -- 172.21.15.116:0/2536840879 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3020020090 con 0x7f303006ba10 2024-01-23T07:33:39.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f3017fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2024-01-23T07:33:39.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f3017fff640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:39.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 10 monclient: shutdown 2024-01-23T07:33:39.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 -- 172.21.15.116:0/4131098912 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 msgr2=0x7f6a58145a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/4131098912 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58145a90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009e50 tx=0x7f6a5002bed0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 -- 172.21.15.116:0/4131098912 shutdown_connections 2024-01-23T07:33:39.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/4131098912 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58145a90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/4131098912 >> v2:172.21.15.116:3300/0 conn(0x7f6a580a96e0 0x7f6a580b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 -- 172.21.15.116:0/4131098912 >> 172.21.15.116:0/4131098912 conn(0x7f6a580b7bb0 msgr2=0x7f6a580b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.062 INFO:teuthology.orchestra.run.smithi116.stdout:64424509449 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 -- 172.21.15.116:0/4131098912 shutdown_connections 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.053+0000 7f6a5e8df640 1 -- 172.21.15.116:0/4131098912 wait complete. 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.054+0000 7f6a5e8df640 10 monclient: build_initial_monmap 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.054+0000 7f6a5e8df640 10 monclient: monmap: 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:39.063 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.055+0000 7f6a5e8df640 1 librados: starting msgr at 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.055+0000 7f6a5e8df640 1 librados: starting objecter 2024-01-23T07:33:39.064 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.055+0000 7f6a5e8df640 1 Processor -- start 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.055+0000 7f937dffb640 1 -- 172.21.15.116:0/3334619579 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378005a10 con 0x7f938813f390 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.055+0000 7f937dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: dump: 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.066 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: _finish_auth 0 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: _check_auth_tickets 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 1 -- 172.21.15.116:0/3334619579 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9378005b70 con 0x7f938813f390 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 5 monclient: authenticate success, global_id 4399 2024-01-23T07:33:39.067 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 10 monclient: _renew_subs 2024-01-23T07:33:39.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93881423a0 con 0x7f938813f390 2024-01-23T07:33:39.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:39.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 1 -- 172.21.15.116:0/3334619579 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9378010610 con 0x7f938813f390 2024-01-23T07:33:39.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 10 librados: watch_flush enter 2024-01-23T07:33:39.068 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937f7fe640 4 set_mon_vals no callback set 2024-01-23T07:33:39.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 10 librados: watch_flush exit 2024-01-23T07:33:39.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 20 client.14300.objecter shutdown clearing up homeless session... 2024-01-23T07:33:39.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 10 client.14300.objecter successfully canceled tick 2024-01-23T07:33:39.069 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f937dffb640 10 monclient: dump: 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.070 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f301c06c8b0 msgr2=0x7f301c06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f301c06c8b0 0x7f301c06ed70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f30301d8440 tx=0x7f3024009190 comp rx=0 tx=0).stop 2024-01-23T07:33:39.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 10 monclient: shutdown 2024-01-23T07:33:39.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f303006ba10 msgr2=0x7f3030140c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f303006ba10 0x7f3030140c90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f302000c400 tx=0x7f302000c8c0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 10 client.4399.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:39.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 10 monclient: _renew_subs 2024-01-23T07:33:39.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f6a5e8df640 1 -- start start 2024-01-23T07:33:39.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f6a5e8df640 1 librados: setting wanted keys 2024-01-23T07:33:39.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f6a5e8df640 1 librados: calling monclient init 2024-01-23T07:33:39.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f6a5e8df640 10 monclient: init 2024-01-23T07:33:39.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93881d7bc0 con 0x7f938813f390 2024-01-23T07:33:39.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.056+0000 7f938f989640 1 librados: init done 2024-01-23T07:33:39.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 shutdown_connections 2024-01-23T07:33:39.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f301c06c8b0 0x7f301c06ed70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.074 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f30300ae400 0x7f30301da880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f303006bdf0 0x7f30301cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f3035c2a640 1 --2- 172.21.15.116:0/2536840879 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f303006ba10 0x7f3030140c90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 >> 172.21.15.116:0/2536840879 conn(0x7f30300b5c70 msgr2=0x7f3030142f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a580a96e0 0x7f6a580b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient(hunting): picked mon.noname-b con 0x7f6a580a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a5813f390 0x7f6a58145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient(hunting): picked mon.noname-a con 0x7f6a5813f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58131d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient(hunting): picked mon.noname-c con 0x7f6a58145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.076 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58137f10 con 0x7f6a5813f390 2024-01-23T07:33:39.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58138580 con 0x7f6a580a96e0 2024-01-23T07:33:39.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f6a5e8df640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.057+0000 7f938f989640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f6a5e8df640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58138d20 con 0x7f6a58145600 2024-01-23T07:33:39.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f6a5e8df640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:39.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f938f989640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f938f989640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f6a5e8df640 10 monclient(hunting): authenticate will time out at 2426.416251s 2024-01-23T07:33:39.078 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9388067d70 con 0x7f938813f390 2024-01-23T07:33:39.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 shutdown_connections 2024-01-23T07:33:39.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f3035c2a640 1 -- 172.21.15.116:0/2536840879 wait complete. 2024-01-23T07:33:39.079 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.058+0000 7f3035c2a640 1 librados: shutdown 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.059+0000 7f6a5ce7c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58131d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.060+0000 7f6a5ce7c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58131d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36624/0 (socket says 172.21.15.116:36624) 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.060+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/1485176103 learned_addr learned my addr 172.21.15.116:0/1485176103 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.060+0000 7f6a5ce7c640 10 monclient(hunting): get_auth_request con 0x7f6a58145600 auth_method 0 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.060+0000 7f6a5ce7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.060+0000 7f6a5ce7c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.060+0000 7f6a5ce7c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.061+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.061+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.061+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.063+0000 7f6a577fe640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a5813f390 0x7f6a58145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.063+0000 7f6a577fe640 10 monclient(hunting): get_auth_request con 0x7f6a5813f390 auth_method 0 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.063+0000 7f6a577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.063+0000 7f6a577fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.063+0000 7f6a577fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.064+0000 7f6a577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.064+0000 7f6a577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.064+0000 7f6a577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.066+0000 7f6a5ce7c640 10 monclient(hunting): handle_auth_done global_id 14312 payload 824 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.066+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/1485176103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a580a96e0 msgr2=0x7f6a580b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.066+0000 7f6a5ce7c640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a580a96e0 0x7f6a580b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.066+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a5813f390 msgr2=0x7f6a58145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.066+0000 7f6a5ce7c640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a5813f390 0x7f6a58145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.066+0000 7f6a5ce7c640 10 monclient: _finish_hunting 0 2024-01-23T07:33:39.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.066+0000 7f6a5ce7c640 1 monclient: found mon.noname-c 2024-01-23T07:33:39.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.067+0000 7f6a5ce7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:39.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.067+0000 7f6a5ce7c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.067+0000 7f6a5ce7c640 1 -- 172.21.15.116:0/1485176103 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a50009b30 con 0x7f6a58145600 2024-01-23T07:33:39.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.067+0000 7f6a577fe640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a5813f390 0x7f6a58145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T07:33:39.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.069+0000 7f6a5ce7c640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58131d00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a50036040 tx=0x7f6a50004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.069+0000 7f6a54ff9640 10 client.?.objecter ms_handle_connect 0x7f6a58145600 2024-01-23T07:33:39.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.069+0000 7f6a54ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:39.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.7 2024-01-23T07:33:39.085 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 1 -- 172.21.15.116:0/1485176103 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a50009510 con 0x7f6a58145600 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: dump: 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.086 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: _finish_auth 0 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: _check_auth_tickets 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 5 monclient: authenticate success, global_id 14312 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 10 monclient: _renew_subs 2024-01-23T07:33:39.087 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a58138800 con 0x7f6a58145600 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 1 -- 172.21.15.116:0/1485176103 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5003e450 con 0x7f6a58145600 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 1 -- 172.21.15.116:0/1485176103 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5003e7e0 con 0x7f6a58145600 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 10 client.14312.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a54ff9640 10 monclient: dump: 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.088 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a567fc640 4 set_mon_vals no callback set 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 10 monclient: _renew_subs 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a58137110 con 0x7f6a58145600 2024-01-23T07:33:39.089 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.074+0000 7f6a5e8df640 1 librados: init done 2024-01-23T07:33:39.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.076+0000 7f937dffb640 1 -- 172.21.15.116:0/3334619579 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9378010770 con 0x7f938813f390 2024-01-23T07:33:39.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.077+0000 7f937dffb640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f936c06c8b0 0x7f936c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.075+0000 7f6a5e8df640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.075+0000 7f6a5e8df640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.090 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.075+0000 7f6a5e8df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.075+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a58067d70 con 0x7f6a58145600 2024-01-23T07:33:39.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.077+0000 7f938d725640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f936c06c8b0 0x7f936c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.077+0000 7f938d725640 10 monclient: get_auth_request con 0x7f936c06c8b0 auth_method 0 2024-01-23T07:33:39.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.077+0000 7f938d725640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f936c06c8b0 0x7f936c06ed70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9384036000 tx=0x7f9384030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.091 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.077+0000 7f937dffb640 10 client.4399.objecter ms_handle_connect 0x7f936c06c8b0 2024-01-23T07:33:39.094 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.094+0000 7f6a54ff9640 1 -- 172.21.15.116:0/1485176103 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6a5003e940 con 0x7f6a58145600 2024-01-23T07:33:39.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.095+0000 7f6a54ff9640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6a4406c8b0 0x7f6a4406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.095+0000 7f6a57fff640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6a4406c8b0 0x7f6a4406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.095 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.095+0000 7f6a57fff640 10 monclient: get_auth_request con 0x7f6a4406c8b0 auth_method 0 2024-01-23T07:33:39.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.096+0000 7f6a57fff640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6a4406c8b0 0x7f6a4406ed70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009710 tx=0x7f6a48006c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.096 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.096+0000 7f6a54ff9640 10 client.14312.objecter ms_handle_connect 0x7f6a4406c8b0 2024-01-23T07:33:39.098 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.098+0000 7f6a54ff9640 1 -- 172.21.15.116:0/1485176103 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6a5007bd10 con 0x7f6a58145600 2024-01-23T07:33:39.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.098+0000 7f6a54ff9640 10 client.14312.objecter ms_dispatch 0x7f6a58000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:39.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.098+0000 7f6a54ff9640 3 client.14312.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:39.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.098+0000 7f6a54ff9640 3 client.14312.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:39.099 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.098+0000 7f6a54ff9640 20 client.14312.objecter dump_active .. 0 homeless 2024-01-23T07:33:39.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.216+0000 7ffa8bab1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:39.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.216+0000 7ffa8bab1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:39.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.216+0000 7ffa8bab1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.216+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa841d78e0 con 0x7ffa84145600 2024-01-23T07:33:39.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.226+0000 7f3333c59640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:39.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.226+0000 7f3333c59640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:39.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.226+0000 7f3333c59640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T07:33:39.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.226+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f332c04ea10 con 0x7f332c145600 2024-01-23T07:33:39.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.230+0000 7f33227fc640 1 -- 172.21.15.116:0/1535327852 <== mon.0 v2:172.21.15.116:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3324019070 con 0x7f332c145600 2024-01-23T07:33:39.230 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.230+0000 7f33227fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-01-23T07:33:39.231 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.230+0000 7f33227fc640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:39.231 INFO:teuthology.orchestra.run.smithi116.stdout:77309411337 2024-01-23T07:33:39.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 10 librados: watch_flush enter 2024-01-23T07:33:39.233 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 10 librados: watch_flush exit 2024-01-23T07:33:39.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 20 client.4416.objecter shutdown clearing up homeless session... 2024-01-23T07:33:39.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 10 client.4416.objecter successfully canceled tick 2024-01-23T07:33:39.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f331006c8b0 msgr2=0x7f331006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f331006c8b0 0x7f331006ed70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3328036000 tx=0x7f3328030000 comp rx=0 tx=0).stop 2024-01-23T07:33:39.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 10 monclient: shutdown 2024-01-23T07:33:39.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.234 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c145600 msgr2=0x7f332c136350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c145600 0x7f332c136350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f332400b9e0 tx=0x7f332400bea0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 shutdown_connections 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f331006c8b0 0x7f331006ed70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f332c145600 0x7f332c136350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f332c13f390 0x7f332c138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 --2- 172.21.15.116:0/1535327852 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f332c0a96e0 0x7f332c144a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 >> 172.21.15.116:0/1535327852 conn(0x7f332c0b7bb0 msgr2=0x7f332c135510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 shutdown_connections 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.232+0000 7f3333c59640 1 -- 172.21.15.116:0/1535327852 wait complete. 2024-01-23T07:33:39.235 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.233+0000 7f3333c59640 1 librados: shutdown 2024-01-23T07:33:39.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 77309411337 got 77309411337 for osd.4 2024-01-23T07:33:39.244 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:39.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.300+0000 7f937dffb640 1 -- 172.21.15.116:0/3334619579 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9378058580 con 0x7f938813f390 2024-01-23T07:33:39.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.300+0000 7f937dffb640 10 client.4399.objecter ms_dispatch 0x7f9388000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:39.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.300+0000 7f937dffb640 3 client.4399.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:39.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.300+0000 7f937dffb640 3 client.4399.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:39.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.300+0000 7f937dffb640 20 client.4399.objecter dump_active .. 0 homeless 2024-01-23T07:33:39.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.310+0000 7f937dffb640 1 -- 172.21.15.116:0/3334619579 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f93780541c0 con 0x7f938813f390 2024-01-23T07:33:39.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.310+0000 7f937dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.310+0000 7f937dffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:39.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.350+0000 7f6a54ff9640 1 -- 172.21.15.116:0/1485176103 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f6a50077950 con 0x7f6a58145600 2024-01-23T07:33:39.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.350+0000 7f6a54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.350+0000 7f6a54ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:39.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.355+0000 7ffa7a7fc640 1 -- 172.21.15.116:0/1347441889 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa841d78e0 con 0x7ffa84145600 2024-01-23T07:33:39.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.355+0000 7ffa7a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-01-23T07:33:39.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.355+0000 7ffa7a7fc640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:39.355 INFO:teuthology.orchestra.run.smithi116.stdout:60129542151 2024-01-23T07:33:39.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.357+0000 7ffa8bab1640 10 librados: watch_flush enter 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 10 librados: watch_flush exit 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 20 client.14306.objecter shutdown clearing up homeless session... 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 10 client.14306.objecter successfully canceled tick 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ffa6806c860 msgr2=0x7ffa6806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ffa6806c860 0x7ffa6806ed20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa80001560 tx=0x7ffa80007990 comp rx=0 tx=0).stop 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 10 monclient: shutdown 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 msgr2=0x7ffa841321b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa841321b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c032000 tx=0x7ffa7c004a40 comp rx=0 tx=0).stop 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 shutdown_connections 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7ffa6806c860 0x7ffa6806ed20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7ffa84145600 0x7ffa841321b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ffa8413faa0 0x7ffa84131c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 --2- 172.21.15.116:0/1347441889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa840a96e0 0x7ffa84140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 >> 172.21.15.116:0/1347441889 conn(0x7ffa840b7bb0 msgr2=0x7ffa84073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 shutdown_connections 2024-01-23T07:33:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 -- 172.21.15.116:0/1347441889 wait complete. 2024-01-23T07:33:39.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.358+0000 7ffa8bab1640 1 librados: shutdown 2024-01-23T07:33:39.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.0 2024-01-23T07:33:39.374 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:39.505 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.505+0000 7f938f989640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:39.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.505+0000 7f938f989640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:39.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.505+0000 7f938f989640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.506 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.505+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9388141ce0 con 0x7f938813f390 2024-01-23T07:33:39.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.509+0000 7f937dffb640 1 -- 172.21.15.116:0/3334619579 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9388141ce0 con 0x7f938813f390 2024-01-23T07:33:39.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.509+0000 7f937dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2024-01-23T07:33:39.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.509+0000 7f937dffb640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:39.509 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-01-23T07:33:39.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.510+0000 7f938f989640 10 librados: watch_flush enter 2024-01-23T07:33:39.511 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.510+0000 7f938f989640 10 librados: watch_flush exit 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.510+0000 7f938f989640 20 client.4399.objecter shutdown clearing up homeless session... 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.510+0000 7f938f989640 10 client.4399.objecter successfully canceled tick 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f936c06c8b0 msgr2=0x7f936c06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f936c06c8b0 0x7f936c06ed70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9384036000 tx=0x7f9384030000 comp rx=0 tx=0).stop 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 10 monclient: shutdown 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f938813f390 msgr2=0x7f9388141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f938813f390 0x7f9388141210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f937800b4a0 tx=0x7f937800b960 comp rx=0 tx=0).stop 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 shutdown_connections 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f936c06c8b0 0x7f936c06ed70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9388145600 0x7f93881d74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f938813f390 0x7f9388141210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 --2- 172.21.15.116:0/3334619579 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f93880a96e0 0x7f93880b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 >> 172.21.15.116:0/3334619579 conn(0x7f93880b7bb0 msgr2=0x7f938813ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 shutdown_connections 2024-01-23T07:33:39.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 -- 172.21.15.116:0/3334619579 wait complete. 2024-01-23T07:33:39.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.511+0000 7f938f989640 1 librados: shutdown 2024-01-23T07:33:39.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-01-23T07:33:39.523 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:39.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.532+0000 7f6a5e8df640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:39.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.532+0000 7f6a5e8df640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:39.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.532+0000 7f6a5e8df640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.533 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.532+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f6a580b38f0 con 0x7f6a58145600 2024-01-23T07:33:39.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.536+0000 7f6a54ff9640 1 -- 172.21.15.116:0/1485176103 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a50043090 con 0x7f6a58145600 2024-01-23T07:33:39.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.536+0000 7f6a54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-01-23T07:33:39.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.536+0000 7f6a54ff9640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:39.536 INFO:teuthology.orchestra.run.smithi116.stdout:55834574854 2024-01-23T07:33:39.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.537+0000 7f6a5e8df640 10 librados: watch_flush enter 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 10 librados: watch_flush exit 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 20 client.14312.objecter shutdown clearing up homeless session... 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 10 client.14312.objecter successfully canceled tick 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6a4406c8b0 msgr2=0x7f6a4406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6a4406c8b0 0x7f6a4406ed70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a48009710 tx=0x7f6a48006c90 comp rx=0 tx=0).stop 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 10 monclient: shutdown 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 msgr2=0x7f6a58131d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58131d00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6a50036040 tx=0x7f6a50004a40 comp rx=0 tx=0).stop 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 shutdown_connections 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6a4406c8b0 0x7f6a4406ed70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6a58145600 0x7f6a58131d00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a5813f390 0x7f6a58145060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 --2- 172.21.15.116:0/1485176103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a580a96e0 0x7f6a580b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 >> 172.21.15.116:0/1485176103 conn(0x7f6a580b7bb0 msgr2=0x7f6a58073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 shutdown_connections 2024-01-23T07:33:39.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 -- 172.21.15.116:0/1485176103 wait complete. 2024-01-23T07:33:39.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.538+0000 7f6a5e8df640 1 librados: shutdown 2024-01-23T07:33:39.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-01-23T07:33:39.550 DEBUG:teuthology.parallel:result is None 2024-01-23T07:33:39.550 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-23T07:33:39.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.692+0000 7f11cf9fb640 10 monclient: get_monmap_and_config 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.692+0000 7f11cf9fb640 10 monclient: build_initial_monmap 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.692+0000 7f11cf9fb640 10 monclient: monmap: 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:39.694103+0000 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:39.694103+0000 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:39.693 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.694 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:39.694 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:39.694 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:39.694 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:39.694 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:39.694 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.693+0000 7f11cf9fb640 1 Processor -- start 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.693+0000 7f11cf9fb640 1 -- start start 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.693+0000 7f11cf9fb640 10 monclient: init 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c80b47b0 0x7f11c81456e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient(hunting): picked mon.noname-b con 0x7f11c80b47b0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:39.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f11c80b4090 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f11c813f7a0 0x7f11c8145c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient(hunting): picked mon.noname-a con 0x7f11c813f7a0 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80aa930 con 0x7f11c80b4090 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c80aa1c0 con 0x7f11c813f7a0 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80b4b90 con 0x7f11c80b47b0 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cf9fb640 10 monclient(hunting): authenticate will time out at 2427.052683s 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.694+0000 7f11cd797640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c80b47b0 0x7f11c81456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.695+0000 7f11cd797640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c80b47b0 0x7f11c81456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36630/0 (socket says 172.21.15.116:36630) 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.695+0000 7f11cd797640 1 -- 172.21.15.116:0/1445752822 learned_addr learned my addr 172.21.15.116:0/1445752822 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.695+0000 7f11cd797640 10 monclient(hunting): get_auth_request con 0x7f11c80b47b0 auth_method 0 2024-01-23T07:33:39.696 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.695+0000 7f11cd797640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.695+0000 7f11cd797640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.695+0000 7f11cd797640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.696+0000 7f11cd797640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.696+0000 7f11cd797640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.696+0000 7f11cd797640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.696+0000 7f11cdf98640 1 --2- 172.21.15.116:0/1445752822 >> v2:172.21.15.116:3300/0 conn(0x7f11c813f7a0 0x7f11c8145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.697+0000 7f11cdf98640 10 monclient(hunting): get_auth_request con 0x7f11c813f7a0 auth_method 0 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.697+0000 7f11cdf98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.697+0000 7f11cdf98640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.697+0000 7f11cdf98640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.697+0000 7f11cd797640 10 monclient(hunting): handle_auth_done global_id 14315 payload 274 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 1 -- 172.21.15.116:0/1445752822 >> v2:172.21.15.116:3300/0 conn(0x7f11c813f7a0 msgr2=0x7f11c8145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 1 --2- 172.21.15.116:0/1445752822 >> v2:172.21.15.116:3300/0 conn(0x7f11c813f7a0 0x7f11c8145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 1 -- 172.21.15.116:0/1445752822 >> v1:172.21.15.116:6789/0 conn(0x7f11c80b4090 legacy=0x7f11c813f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:39.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 10 monclient: _finish_hunting 0 2024-01-23T07:33:39.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 1 monclient: found mon.noname-b 2024-01-23T07:33:39.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:39.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:39.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.698+0000 7f11cd797640 1 -- 172.21.15.116:0/1445752822 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80aaba0 con 0x7f11c80b47b0 2024-01-23T07:33:39.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.700+0000 7f11cd797640 1 --2- 172.21.15.116:0/1445752822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c80b47b0 0x7f11c81456e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009870 tx=0x7f11c402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a19d3b382cccb48 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.704+0000 7f11bffff640 1 -- 172.21.15.116:0/1445752822 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40317c0 con 0x7f11c80b47b0 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: dump: 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.705 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: _finish_auth 0 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: _check_auth_tickets 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 1 -- 172.21.15.116:0/1445752822 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c4031920 con 0x7f11c80b47b0 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 1 -- 172.21.15.116:0/1445752822 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4031cb0 con 0x7f11c80b47b0 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 5 monclient: authenticate success, global_id 14315 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:39.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 4 set_mon_vals no callback set 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11bffff640 10 monclient: dump: 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.707 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 10 monclient: shutdown 2024-01-23T07:33:39.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:39.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 1 -- 172.21.15.116:0/1445752822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c80b47b0 msgr2=0x7f11c81456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/1445752822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c80b47b0 0x7f11c81456e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009870 tx=0x7f11c402b860 comp rx=0 tx=0).stop 2024-01-23T07:33:39.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 1 -- 172.21.15.116:0/1445752822 shutdown_connections 2024-01-23T07:33:39.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/1445752822 >> v2:172.21.15.116:3300/0 conn(0x7f11c813f7a0 0x7f11c8145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/1445752822 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c80b47b0 0x7f11c81456e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.705+0000 7f11cf9fb640 1 -- 172.21.15.116:0/1445752822 >> 172.21.15.116:0/1445752822 conn(0x7f11c8066450 msgr2=0x7f11c8066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.706+0000 7f11cf9fb640 1 -- 172.21.15.116:0/1445752822 shutdown_connections 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.706+0000 7f11cf9fb640 1 -- 172.21.15.116:0/1445752822 wait complete. 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.706+0000 7f11cf9fb640 10 monclient: build_initial_monmap 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.706+0000 7f11cf9fb640 10 monclient: monmap: 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:39.711 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 librados: starting msgr at 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 librados: starting objecter 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 Processor -- start 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 -- start start 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 librados: setting wanted keys 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 librados: calling monclient init 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient: init 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11c80b4090 0x7f11c8138670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): picked mon.noname-b con 0x7f11c80b4090 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80b47b0 0x7f11c81330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): picked mon.noname-a con 0x7f11c80b47b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c813f7a0 0x7f11c81da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): picked mon.noname-c con 0x7f11c813f7a0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c813a450 con 0x7f11c80b47b0 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c813abe0 con 0x7f11c80b4090 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c813a6a0 con 0x7f11c813f7a0 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.707+0000 7f11cf9fb640 10 monclient(hunting): authenticate will time out at 2427.065988s 2024-01-23T07:33:39.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cdf98640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c813f7a0 0x7f11c81da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cd797640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11c80b4090 0x7f11c8138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cdf98640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c813f7a0 0x7f11c81da8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36644/0 (socket says 172.21.15.116:36644) 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cdf98640 1 -- 172.21.15.116:0/2798630787 learned_addr learned my addr 172.21.15.116:0/2798630787 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cdf98640 10 monclient(hunting): get_auth_request con 0x7f11c813f7a0 auth_method 0 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cdf98640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cdf98640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cdf98640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cd797640 10 monclient(hunting): get_auth_request con 0x7f11c80b4090 auth_method 0 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cd797640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cd797640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.708+0000 7f11cd797640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.709+0000 7f11cd797640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.709+0000 7f11cd797640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.709+0000 7f11cd797640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.709+0000 7f11cdf98640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:39.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.709+0000 7f11cdf98640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:39.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.709+0000 7f11cdf98640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:39.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.711+0000 7f11cd797640 10 monclient(hunting): handle_auth_done global_id 4402 payload 824 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.711+0000 7f11cd797640 1 -- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c813f7a0 msgr2=0x7f11c81da8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.711+0000 7f11cd797640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c813f7a0 0x7f11c81da8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.711+0000 7f11cd797640 1 -- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80b47b0 msgr2=0x7f11c81330f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.711+0000 7f11cd797640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80b47b0 0x7f11c81330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.712+0000 7f11cd797640 10 monclient: _finish_hunting 0 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.712+0000 7f11cd797640 1 monclient: found mon.noname-b 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.712+0000 7f11cd797640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.712+0000 7f11cd797640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.712+0000 7f11cd797640 1 -- 172.21.15.116:0/2798630787 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40094d0 con 0x7f11c80b4090 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.714+0000 7f11cd797640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11c80b4090 0x7f11c8138670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11c80b8ac0 tx=0x7f11c40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.714+0000 7f11bdffb640 10 client.?.objecter ms_handle_connect 0x7f11c80b4090 2024-01-23T07:33:39.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.714+0000 7f11bdffb640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:39.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 1 -- 172.21.15.116:0/2798630787 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4032860 con 0x7f11c80b4090 2024-01-23T07:33:39.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:39.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: dump: 2024-01-23T07:33:39.718 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.718 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.718 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: _finish_auth 0 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: _check_auth_tickets 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 1 -- 172.21.15.116:0/2798630787 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c40329e0 con 0x7f11c80b4090 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11cf9fb640 5 monclient: authenticate success, global_id 4402 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11cf9fb640 10 monclient: _renew_subs 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11cf9fb640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c8133630 con 0x7f11c80b4090 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 1 -- 172.21.15.116:0/2798630787 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4032d90 con 0x7f11c80b4090 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bdffb640 10 monclient: dump: 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:39.720 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.718+0000 7f11cf9fb640 10 client.4402.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.718+0000 7f11cf9fb640 10 monclient: _renew_subs 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.717+0000 7f11bf7fe640 4 set_mon_vals no callback set 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.718+0000 7f11cf9fb640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.718+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c813b5a0 con 0x7f11c80b4090 2024-01-23T07:33:39.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.718+0000 7f11cf9fb640 1 librados: init done 2024-01-23T07:33:39.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.718+0000 7f11cf9fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.719+0000 7f11cf9fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.719+0000 7f11cf9fb640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:33:39.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.719+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c8067d70 con 0x7f11c80b4090 2024-01-23T07:33:39.737 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.737+0000 7f11bdffb640 1 -- 172.21.15.116:0/2798630787 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f11c404e450 con 0x7f11c80b4090 2024-01-23T07:33:39.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.737+0000 7f11bdffb640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f11ac06c8b0 0x7f11ac06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:39.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.737+0000 7f11ccf96640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f11ac06c8b0 0x7f11ac06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:39.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.738+0000 7f11ccf96640 10 monclient: get_auth_request con 0x7f11ac06c8b0 auth_method 0 2024-01-23T07:33:39.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.738+0000 7f11bdffb640 10 client.4402.objecter ms_handle_connect 0x7f11ac06c8b0 2024-01-23T07:33:39.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.738+0000 7f11ccf96640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f11ac06c8b0 0x7f11ac06ed70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11c80b4490 tx=0x7f11b8007990 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:39.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.739+0000 7f11bdffb640 1 -- 172.21.15.116:0/2798630787 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f11c407aa20 con 0x7f11c80b4090 2024-01-23T07:33:39.739 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.739+0000 7f11bdffb640 10 client.4402.objecter ms_dispatch 0x7f11c8000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:39.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.739+0000 7f11bdffb640 3 client.4402.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:39.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.739+0000 7f11bdffb640 3 client.4402.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:39.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.739+0000 7f11bdffb640 20 client.4402.objecter dump_active .. 0 homeless 2024-01-23T07:33:39.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.983+0000 7f11bdffb640 1 -- 172.21.15.116:0/2798630787 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f11c4076660 con 0x7f11c80b4090 2024-01-23T07:33:39.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.983+0000 7f11bdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:39.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:39.983+0000 7f11bdffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:40.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.158+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11c80ab160 con 0x7f11ac06c8b0 2024-01-23T07:33:40.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.160+0000 7f11bdffb640 1 -- 172.21.15.116:0/2798630787 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48013 (secure 0 0 0) 0x7f11b80050d0 con 0x7f11ac06c8b0 2024-01-23T07:33:40.161 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:33:40.161 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-01-23T07:33:40.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 10 librados: watch_flush enter 2024-01-23T07:33:40.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 10 librados: watch_flush exit 2024-01-23T07:33:40.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 20 client.4402.objecter shutdown clearing up homeless session... 2024-01-23T07:33:40.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 10 client.4402.objecter successfully canceled tick 2024-01-23T07:33:40.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f11ac06c8b0 msgr2=0x7f11ac06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.163 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f11ac06c8b0 0x7f11ac06ed70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11c80b4490 tx=0x7f11b8007990 comp rx=0 tx=0).stop 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 10 monclient: shutdown 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11c80b4090 msgr2=0x7f11c8138670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11c80b4090 0x7f11c8138670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f11c80b8ac0 tx=0x7f11c40046c0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 shutdown_connections 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f11ac06c8b0 0x7f11ac06ed70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f11c813f7a0 0x7f11c81da8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f11c80b47b0 0x7f11c81330f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 --2- 172.21.15.116:0/2798630787 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11c80b4090 0x7f11c8138670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 >> 172.21.15.116:0/2798630787 conn(0x7f11c8066450 msgr2=0x7f11c80b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 shutdown_connections 2024-01-23T07:33:40.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.162+0000 7f11cf9fb640 1 -- 172.21.15.116:0/2798630787 wait complete. 2024-01-23T07:33:40.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.163+0000 7f11cf9fb640 1 librados: shutdown 2024-01-23T07:33:40.173 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-01-23T07:33:38.382661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218776,"kb_used_data":2596,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755944,"statfs":{"total":773094113280,"available":772870086656,"internally_reserved":0,"allocated":2658304,"data_stored":1450052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.474189"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.334758+0000","last_change":"2024-01-23T07:33:32.685400+0000","last_active":"2024-01-23T07:33:34.334758+0000","last_peered":"2024-01-23T07:33:34.334758+0000","last_clean":"2024-01-23T07:33:34.334758+0000","last_became_active":"2024-01-23T07:33:32.676672+0000","last_became_peered":"2024-01-23T07:33:32.676672+0000","last_unstale":"2024-01-23T07:33:34.334758+0000","last_undegraded":"2024-01-23T07:33:34.334758+0000","last_fullsized":"2024-01-23T07:33:34.334758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:20:29.458030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:33.123341+0000","last_change":"2024-01-23T07:33:32.719529+0000","last_active":"2024-01-23T07:33:33.123341+0000","last_peered":"2024-01-23T07:33:33.123341+0000","last_clean":"2024-01-23T07:33:33.123341+0000","last_became_active":"2024-01-23T07:33:32.693171+0000","last_became_peered":"2024-01-23T07:33:32.693171+0000","last_unstale":"2024-01-23T07:33:33.123341+0000","last_undegraded":"2024-01-23T07:33:33.123341+0000","last_fullsized":"2024-01-23T07:33:33.123341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:08:58.102768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.313702+0000","last_change":"2024-01-23T07:33:32.371113+0000","last_active":"2024-01-23T07:33:34.313702+0000","last_peered":"2024-01-23T07:33:34.313702+0000","last_clean":"2024-01-23T07:33:34.313702+0000","last_became_active":"2024-01-23T07:33:32.353826+0000","last_became_peered":"2024-01-23T07:33:32.353826+0000","last_unstale":"2024-01-23T07:33:34.313702+0000","last_undegraded":"2024-01-23T07:33:34.313702+0000","last_fullsized":"2024-01-23T07:33:34.313702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:16:09.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:33.064977+0000","last_change":"2024-01-23T07:33:32.481074+0000","last_active":"2024-01-23T07:33:33.064977+0000","last_peered":"2024-01-23T07:33:33.064977+0000","last_clean":"2024-01-23T07:33:33.064977+0000","last_became_active":"2024-01-23T07:33:32.474543+0000","last_became_peered":"2024-01-23T07:33:32.474543+0000","last_unstale":"2024-01-23T07:33:33.064977+0000","last_undegraded":"2024-01-23T07:33:33.064977+0000","last_fullsized":"2024-01-23T07:33:33.064977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:34:40.212856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.323535+0000","last_change":"2024-01-23T07:33:32.478085+0000","last_active":"2024-01-23T07:33:34.323535+0000","last_peered":"2024-01-23T07:33:34.323535+0000","last_clean":"2024-01-23T07:33:34.323535+0000","last_became_active":"2024-01-23T07:33:32.468117+0000","last_became_peered":"2024-01-23T07:33:32.468117+0000","last_unstale":"2024-01-23T07:33:34.323535+0000","last_undegraded":"2024-01-23T07:33:34.323535+0000","last_fullsized":"2024-01-23T07:33:34.323535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:53:49.321585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:33.340973+0000","last_change":"2024-01-23T07:33:32.242622+0000","last_active":"2024-01-23T07:33:33.340973+0000","last_peered":"2024-01-23T07:33:33.340973+0000","last_clean":"2024-01-23T07:33:33.340973+0000","last_became_active":"2024-01-23T07:33:32.214733+0000","last_became_peered":"2024-01-23T07:33:32.214733+0000","last_unstale":"2024-01-23T07:33:33.340973+0000","last_undegraded":"2024-01-23T07:33:33.340973+0000","last_fullsized":"2024-01-23T07:33:33.340973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:56:15.909111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.303186+0000","last_change":"2024-01-23T07:33:32.273001+0000","last_active":"2024-01-23T07:33:34.303186+0000","last_peered":"2024-01-23T07:33:34.303186+0000","last_clean":"2024-01-23T07:33:34.303186+0000","last_became_active":"2024-01-23T07:33:32.242199+0000","last_became_peered":"2024-01-23T07:33:32.242199+0000","last_unstale":"2024-01-23T07:33:34.303186+0000","last_undegraded":"2024-01-23T07:33:34.303186+0000","last_fullsized":"2024-01-23T07:33:34.303186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:00:09.885876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.318453+0000","last_change":"2024-01-23T07:33:32.660913+0000","last_active":"2024-01-23T07:33:34.318453+0000","last_peered":"2024-01-23T07:33:34.318453+0000","last_clean":"2024-01-23T07:33:34.318453+0000","last_became_active":"2024-01-23T07:33:32.655848+0000","last_became_peered":"2024-01-23T07:33:32.655848+0000","last_unstale":"2024-01-23T07:33:34.318453+0000","last_undegraded":"2024-01-23T07:33:34.318453+0000","last_fullsized":"2024-01-23T07:33:34.318453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:09:57.469855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'76","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.266658+0000","last_change":"2024-01-23T07:33:26.319611+0000","last_active":"2024-01-23T07:33:34.266658+0000","last_peered":"2024-01-23T07:33:34.266658+0000","last_clean":"2024-01-23T07:33:34.266658+0000","last_became_active":"2024-01-23T07:33:25.600297+0000","last_became_peered":"2024-01-23T07:33:25.600297+0000","last_unstale":"2024-01-23T07:33:34.266658+0000","last_undegraded":"2024-01-23T07:33:34.266658+0000","last_fullsized":"2024-01-23T07:33:34.266658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_clean_scrub_stamp":"2024-01-23T07:33:13.116593+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:32:26.093374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":19,"seq":81604378636,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.5150000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8390000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.456}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":373.13400000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":30.018000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.531000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":420.70699999999999}]}]},{"osd":1,"up_from":19,"seq":81604378634,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":474607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.013999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":40.630000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.204000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":47.603000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":32.168999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":34.883000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":20.329999999999998}]}]},{"osd":4,"up_from":18,"seq":77309411338,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9829999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.106999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.712999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.263}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.949000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.109000000000002}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":150.887}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8710000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":134.61000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.673}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.952999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.585999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":54.655000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.699}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":57.241}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.734}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":62.350000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.471}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":78.488}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":28.946999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.7609999999999992}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.879000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.4870000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":28.384}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.82}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.382999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":29.501999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.258}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.875}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.271000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.931000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.813000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.999000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":634880,"data_stored":480355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.778}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.0190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.148999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.77}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.042999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.751000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.701000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T07:33:40.175 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T07:33:40.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.273+0000 7fbd5b16b640 10 monclient: get_monmap_and_config 2024-01-23T07:33:40.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.273+0000 7fbd5b16b640 10 monclient: build_initial_monmap 2024-01-23T07:33:40.273 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.273+0000 7fbd5b16b640 10 monclient: monmap: 2024-01-23T07:33:40.273 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:40.273 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.273 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:40.274284+0000 2024-01-23T07:33:40.273 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:40.274284+0000 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:40.274 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.273+0000 7fbd5b16b640 1 Processor -- start 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.273+0000 7fbd5b16b640 1 -- start start 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.273+0000 7fbd5b16b640 10 monclient: init 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient: _add_conns ranks=[2,0,3,1,4] 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd540b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient(hunting): picked mon.noname-b con 0x7fbd540a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:40.276 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fbd5413f390 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd54145600 0x7fbd54145a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient(hunting): picked mon.noname-a con 0x7fbd54145600 addr v2:172.21.15.116:3300/0 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd540aac10 con 0x7fbd5413f390 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd540a9e00 con 0x7fbd54145600 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540a9ac0 con 0x7fbd540a96e0 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.274+0000 7fbd5b16b640 10 monclient(hunting): authenticate will time out at 2427.632682s 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd540b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd59708640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbd54145600 0x7fbd54145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd540b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36658/0 (socket says 172.21.15.116:36658) 2024-01-23T07:33:40.277 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 1 -- 172.21.15.116:0/2204988117 learned_addr learned my addr 172.21.15.116:0/2204988117 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 10 monclient(hunting): get_auth_request con 0x7fbd540a96e0 auth_method 0 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd59708640 10 monclient(hunting): get_auth_request con 0x7fbd54145600 auth_method 0 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd59708640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd59708640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd59708640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.275+0000 7fbd58f07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.276+0000 7fbd59708640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.276+0000 7fbd59708640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.278 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.276+0000 7fbd59708640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 10 monclient(hunting): handle_auth_done global_id 14321 payload 274 2024-01-23T07:33:40.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 1 -- 172.21.15.116:0/2204988117 >> v2:172.21.15.116:3300/0 conn(0x7fbd54145600 msgr2=0x7fbd54145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:40.279 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 1 --2- 172.21.15.116:0/2204988117 >> v2:172.21.15.116:3300/0 conn(0x7fbd54145600 0x7fbd54145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 1 -- 172.21.15.116:0/2204988117 >> v1:172.21.15.116:6789/0 conn(0x7fbd5413f390 legacy=0x7fbd5413f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 10 monclient: _finish_hunting 0 2024-01-23T07:33:40.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 1 monclient: found mon.noname-b 2024-01-23T07:33:40.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:40.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.277+0000 7fbd58f07640 1 -- 172.21.15.116:0/2204988117 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540aae80 con 0x7fbd540a96e0 2024-01-23T07:33:40.280 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.279+0000 7fbd58f07640 1 --2- 172.21.15.116:0/2204988117 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd540b1850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009870 tx=0x7fbd5002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9726e46598205c6d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:40.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 1 -- 172.21.15.116:0/2204988117 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50030840 con 0x7fbd540a96e0 2024-01-23T07:33:40.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:40.284 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: dump: 2024-01-23T07:33:40.284 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.284 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.284 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: _finish_auth 0 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: _check_auth_tickets 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 1 -- 172.21.15.116:0/2204988117 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd500309a0 con 0x7fbd540a96e0 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd5b16b640 5 monclient: authenticate success, global_id 14321 2024-01-23T07:33:40.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd5b16b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd5b16b640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd5b16b640 4 set_mon_vals no callback set 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 1 -- 172.21.15.116:0/2204988117 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50030d30 con 0x7fbd540a96e0 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.283+0000 7fbd4b7fe640 10 monclient: dump: 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.286 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 10 monclient: shutdown 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 -- 172.21.15.116:0/2204988117 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 msgr2=0x7fbd540b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/2204988117 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd540b1850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009870 tx=0x7fbd5002b980 comp rx=0 tx=0).stop 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 -- 172.21.15.116:0/2204988117 shutdown_connections 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/2204988117 >> v2:172.21.15.116:3300/0 conn(0x7fbd54145600 0x7fbd54145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/2204988117 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd540b1850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 -- 172.21.15.116:0/2204988117 >> 172.21.15.116:0/2204988117 conn(0x7fbd540b7bb0 msgr2=0x7fbd540b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 -- 172.21.15.116:0/2204988117 shutdown_connections 2024-01-23T07:33:40.287 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 1 -- 172.21.15.116:0/2204988117 wait complete. 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 10 monclient: build_initial_monmap 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.284+0000 7fbd5b16b640 10 monclient: monmap: 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.291 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:40.292 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 librados: starting msgr at 2024-01-23T07:33:40.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 librados: starting objecter 2024-01-23T07:33:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 Processor -- start 2024-01-23T07:33:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 -- start start 2024-01-23T07:33:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 librados: setting wanted keys 2024-01-23T07:33:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 librados: calling monclient init 2024-01-23T07:33:40.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 10 monclient: init 2024-01-23T07:33:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T07:33:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd54131f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 10 monclient(hunting): picked mon.noname-c con 0x7fbd540a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5413f390 0x7fbd54133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.285+0000 7fbd5b16b640 10 monclient(hunting): picked mon.noname-a con 0x7fbd5413f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54145600 0x7fbd541d84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 10 monclient(hunting): picked mon.noname-b con 0x7fbd54145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54135310 con 0x7fbd5413f390 2024-01-23T07:33:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd54133340 con 0x7fbd54145600 2024-01-23T07:33:40.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd541359a0 con 0x7fbd540a96e0 2024-01-23T07:33:40.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:40.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd5b16b640 10 monclient(hunting): authenticate will time out at 2427.644233s 2024-01-23T07:33:40.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd58f07640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd54131f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd4bfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5413f390 0x7fbd54133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd58f07640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd54131f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36664/0 (socket says 172.21.15.116:36664) 2024-01-23T07:33:40.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd58f07640 1 -- 172.21.15.116:0/152028915 learned_addr learned my addr 172.21.15.116:0/152028915 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:40.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd58f07640 10 monclient(hunting): get_auth_request con 0x7fbd540a96e0 auth_method 0 2024-01-23T07:33:40.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd58f07640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd58f07640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd58f07640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd4bfff640 10 monclient(hunting): get_auth_request con 0x7fbd5413f390 auth_method 0 2024-01-23T07:33:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd4bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd4bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.286+0000 7fbd59708640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54145600 0x7fbd541d84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd58f07640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd58f07640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd58f07640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd59708640 10 monclient(hunting): get_auth_request con 0x7fbd54145600 auth_method 0 2024-01-23T07:33:40.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd59708640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd59708640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd59708640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd4bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd4bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd4bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd59708640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd59708640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.287+0000 7fbd59708640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 10 monclient(hunting): handle_auth_done global_id 14324 payload 824 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 1 -- 172.21.15.116:0/152028915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54145600 msgr2=0x7fbd541d84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54145600 0x7fbd541d84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 1 -- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5413f390 msgr2=0x7fbd54133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5413f390 0x7fbd54133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 10 monclient: _finish_hunting 0 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 1 monclient: found mon.noname-c 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.289+0000 7fbd58f07640 1 -- 172.21.15.116:0/152028915 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500094d0 con 0x7fbd540a96e0 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.292+0000 7fbd58f07640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd54131f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd50000c00 tx=0x7fbd50004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.292+0000 7fbd497fa640 10 client.?.objecter ms_handle_connect 0x7fbd540a96e0 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.292+0000 7fbd497fa640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 1 -- 172.21.15.116:0/152028915 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50039c90 con 0x7fbd540a96e0 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: dump: 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.303 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: _finish_auth 0 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: _check_auth_tickets 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 1 -- 172.21.15.116:0/152028915 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50039df0 con 0x7fbd540a96e0 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 5 monclient: authenticate success, global_id 14324 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 10 monclient: _renew_subs 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd54135b10 con 0x7fbd540a96e0 2024-01-23T07:33:40.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 1 -- 172.21.15.116:0/152028915 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50043640 con 0x7fbd540a96e0 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd497fa640 10 monclient: dump: 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.305 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 10 client.14324.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd4affd640 4 set_mon_vals no callback set 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 10 monclient: _renew_subs 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd54132e60 con 0x7fbd540a96e0 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.295+0000 7fbd5b16b640 1 librados: init done 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.296+0000 7fbd5b16b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.296+0000 7fbd5b16b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.296+0000 7fbd5b16b640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.296+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd54067d70 con 0x7fbd540a96e0 2024-01-23T07:33:40.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.314+0000 7fbd497fa640 1 -- 172.21.15.116:0/152028915 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbd500437a0 con 0x7fbd540a96e0 2024-01-23T07:33:40.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.314+0000 7fbd497fa640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd4006c8e0 0x7fbd4006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.314+0000 7fbd4bfff640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd4006c8e0 0x7fbd4006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.314+0000 7fbd4bfff640 10 monclient: get_auth_request con 0x7fbd4006c8e0 auth_method 0 2024-01-23T07:33:40.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.315+0000 7fbd497fa640 10 client.14324.objecter ms_handle_connect 0x7fbd4006c8e0 2024-01-23T07:33:40.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.315+0000 7fbd4bfff640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd4006c8e0 0x7fbd4006eda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd541332f0 tx=0x7fbd44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:40.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.316+0000 7fbd497fa640 1 -- 172.21.15.116:0/152028915 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbd5003e070 con 0x7fbd540a96e0 2024-01-23T07:33:40.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.316+0000 7fbd497fa640 10 client.14324.objecter ms_dispatch 0x7fbd54000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:40.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.316+0000 7fbd497fa640 3 client.14324.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:40.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.316+0000 7fbd497fa640 3 client.14324.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:40.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.316+0000 7fbd497fa640 20 client.14324.objecter dump_active .. 0 homeless 2024-01-23T07:33:40.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.556+0000 7fbd497fa640 1 -- 172.21.15.116:0/152028915 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fbd50077f20 con 0x7fbd540a96e0 2024-01-23T07:33:40.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.556+0000 7fbd497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:40.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.556+0000 7fbd497fa640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:40.738 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.738+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd54133140 con 0x7fbd4006c8e0 2024-01-23T07:33:40.740 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.740+0000 7fbd497fa640 1 -- 172.21.15.116:0/152028915 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47928 (secure 0 0 0) 0x7fbd54133140 con 0x7fbd4006c8e0 2024-01-23T07:33:40.740 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:33:40.741 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-01-23T07:33:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 10 librados: watch_flush enter 2024-01-23T07:33:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 10 librados: watch_flush exit 2024-01-23T07:33:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 20 client.14324.objecter shutdown clearing up homeless session... 2024-01-23T07:33:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 10 client.14324.objecter successfully canceled tick 2024-01-23T07:33:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd4006c8e0 msgr2=0x7fbd4006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd4006c8e0 0x7fbd4006eda0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbd541332f0 tx=0x7fbd44009040 comp rx=0 tx=0).stop 2024-01-23T07:33:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 10 monclient: shutdown 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 msgr2=0x7fbd54131f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd54131f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd50000c00 tx=0x7fbd50004730 comp rx=0 tx=0).stop 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 shutdown_connections 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbd4006c8e0 0x7fbd4006eda0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54145600 0x7fbd541d84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbd5413f390 0x7fbd54133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 --2- 172.21.15.116:0/152028915 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbd540a96e0 0x7fbd54131f30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 >> 172.21.15.116:0/152028915 conn(0x7fbd540b7bb0 msgr2=0x7fbd54073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 shutdown_connections 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 -- 172.21.15.116:0/152028915 wait complete. 2024-01-23T07:33:40.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.742+0000 7fbd5b16b640 1 librados: shutdown 2024-01-23T07:33:40.753 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-01-23T07:33:40.382945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218784,"kb_used_data":2608,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755936,"statfs":{"total":773094113280,"available":772870078464,"internally_reserved":0,"allocated":2670592,"data_stored":1455800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.441548"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.334758+0000","last_change":"2024-01-23T07:33:32.685400+0000","last_active":"2024-01-23T07:33:34.334758+0000","last_peered":"2024-01-23T07:33:34.334758+0000","last_clean":"2024-01-23T07:33:34.334758+0000","last_became_active":"2024-01-23T07:33:32.676672+0000","last_became_peered":"2024-01-23T07:33:32.676672+0000","last_unstale":"2024-01-23T07:33:34.334758+0000","last_undegraded":"2024-01-23T07:33:34.334758+0000","last_fullsized":"2024-01-23T07:33:34.334758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:20:29.458030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:33.123341+0000","last_change":"2024-01-23T07:33:32.719529+0000","last_active":"2024-01-23T07:33:33.123341+0000","last_peered":"2024-01-23T07:33:33.123341+0000","last_clean":"2024-01-23T07:33:33.123341+0000","last_became_active":"2024-01-23T07:33:32.693171+0000","last_became_peered":"2024-01-23T07:33:32.693171+0000","last_unstale":"2024-01-23T07:33:33.123341+0000","last_undegraded":"2024-01-23T07:33:33.123341+0000","last_fullsized":"2024-01-23T07:33:33.123341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:08:58.102768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.313702+0000","last_change":"2024-01-23T07:33:32.371113+0000","last_active":"2024-01-23T07:33:34.313702+0000","last_peered":"2024-01-23T07:33:34.313702+0000","last_clean":"2024-01-23T07:33:34.313702+0000","last_became_active":"2024-01-23T07:33:32.353826+0000","last_became_peered":"2024-01-23T07:33:32.353826+0000","last_unstale":"2024-01-23T07:33:34.313702+0000","last_undegraded":"2024-01-23T07:33:34.313702+0000","last_fullsized":"2024-01-23T07:33:34.313702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:16:09.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:33.064977+0000","last_change":"2024-01-23T07:33:32.481074+0000","last_active":"2024-01-23T07:33:33.064977+0000","last_peered":"2024-01-23T07:33:33.064977+0000","last_clean":"2024-01-23T07:33:33.064977+0000","last_became_active":"2024-01-23T07:33:32.474543+0000","last_became_peered":"2024-01-23T07:33:32.474543+0000","last_unstale":"2024-01-23T07:33:33.064977+0000","last_undegraded":"2024-01-23T07:33:33.064977+0000","last_fullsized":"2024-01-23T07:33:33.064977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:34:40.212856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.323535+0000","last_change":"2024-01-23T07:33:32.478085+0000","last_active":"2024-01-23T07:33:34.323535+0000","last_peered":"2024-01-23T07:33:34.323535+0000","last_clean":"2024-01-23T07:33:34.323535+0000","last_became_active":"2024-01-23T07:33:32.468117+0000","last_became_peered":"2024-01-23T07:33:32.468117+0000","last_unstale":"2024-01-23T07:33:34.323535+0000","last_undegraded":"2024-01-23T07:33:34.323535+0000","last_fullsized":"2024-01-23T07:33:34.323535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:53:49.321585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:33.340973+0000","last_change":"2024-01-23T07:33:32.242622+0000","last_active":"2024-01-23T07:33:33.340973+0000","last_peered":"2024-01-23T07:33:33.340973+0000","last_clean":"2024-01-23T07:33:33.340973+0000","last_became_active":"2024-01-23T07:33:32.214733+0000","last_became_peered":"2024-01-23T07:33:32.214733+0000","last_unstale":"2024-01-23T07:33:33.340973+0000","last_undegraded":"2024-01-23T07:33:33.340973+0000","last_fullsized":"2024-01-23T07:33:33.340973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:56:15.909111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.303186+0000","last_change":"2024-01-23T07:33:32.273001+0000","last_active":"2024-01-23T07:33:34.303186+0000","last_peered":"2024-01-23T07:33:34.303186+0000","last_clean":"2024-01-23T07:33:34.303186+0000","last_became_active":"2024-01-23T07:33:32.242199+0000","last_became_peered":"2024-01-23T07:33:32.242199+0000","last_unstale":"2024-01-23T07:33:34.303186+0000","last_undegraded":"2024-01-23T07:33:34.303186+0000","last_fullsized":"2024-01-23T07:33:34.303186+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:00:09.885876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.318453+0000","last_change":"2024-01-23T07:33:32.660913+0000","last_active":"2024-01-23T07:33:34.318453+0000","last_peered":"2024-01-23T07:33:34.318453+0000","last_clean":"2024-01-23T07:33:34.318453+0000","last_became_active":"2024-01-23T07:33:32.655848+0000","last_became_peered":"2024-01-23T07:33:32.655848+0000","last_unstale":"2024-01-23T07:33:34.318453+0000","last_undegraded":"2024-01-23T07:33:34.318453+0000","last_fullsized":"2024-01-23T07:33:34.318453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:09:57.469855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'76","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-01-23T07:33:34.266658+0000","last_change":"2024-01-23T07:33:26.319611+0000","last_active":"2024-01-23T07:33:34.266658+0000","last_peered":"2024-01-23T07:33:34.266658+0000","last_clean":"2024-01-23T07:33:34.266658+0000","last_became_active":"2024-01-23T07:33:25.600297+0000","last_became_peered":"2024-01-23T07:33:25.600297+0000","last_unstale":"2024-01-23T07:33:34.266658+0000","last_undegraded":"2024-01-23T07:33:34.266658+0000","last_fullsized":"2024-01-23T07:33:34.266658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_clean_scrub_stamp":"2024-01-23T07:33:13.116593+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:32:26.093374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":19,"seq":81604378637,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.46}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.138}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.481999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.594000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.353}]}]},{"osd":1,"up_from":19,"seq":81604378635,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":634880,"data_stored":480355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.5289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.7530000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.289}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.553999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.412000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.785}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.967000000000001}]}]},{"osd":4,"up_from":18,"seq":77309411338,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.9829999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.106999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.712999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.263}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.949000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.109000000000002}]}]},{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":150.887}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.8710000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":134.61000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.673}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.952999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.585999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":54.655000000000001}]}]},{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.699}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":57.241}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.734}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":62.350000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.471}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":78.488}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":28.946999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1870000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.385999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.698}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.026}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.157}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.561999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":18.489000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":82515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.258}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.875}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.271000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.931000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.813000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.999000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":634880,"data_stored":480355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.778}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.0190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.148999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.77}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.042999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.751000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.701000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T07:33:40.754 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-23T07:33:40.754 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-23T07:33:40.754 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-23T07:33:40.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.856+0000 7f0d38b4e640 10 monclient: get_monmap_and_config 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.856+0000 7f0d38b4e640 10 monclient: build_initial_monmap 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.856+0000 7f0d38b4e640 10 monclient: monmap: 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:33:40.857910+0000 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:33:40.857910+0000 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:40.857 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.858 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T07:33:40.858 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T07:33:40.858 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T07:33:40.858 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T07:33:40.858 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T07:33:40.858 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.857+0000 7f0d38b4e640 1 Processor -- start 2024-01-23T07:33:40.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.857+0000 7f0d38b4e640 1 -- start start 2024-01-23T07:33:40.860 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.857+0000 7f0d38b4e640 10 monclient: init 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient: _add_conns ranks=[0,1,2,4,3] 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0d340a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f0d3413faa0 addr v1:172.21.15.173:6789/0 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d34145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient(hunting): picked mon.noname-b con 0x7f0d340b1850 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340aac10 con 0x7f0d340a96e0 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d340a9ac0 con 0x7f0d3413faa0 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d340a9e00 con 0x7f0d340b1850 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d38b4e640 10 monclient(hunting): authenticate will time out at 2428.216302s 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d32d9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d34145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d2bfff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f0d3413faa0 0x7f0d34145600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:50004/0 (socket says 172.21.15.116:50004) 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.858+0000 7f0d2bfff640 1 -- 172.21.15.116:0/2755555717 learned_addr learned my addr 172.21.15.116:0/2755555717 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.859+0000 7f0d32d9d640 10 monclient(hunting): get_auth_request con 0x7f0d340b1850 auth_method 0 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.859+0000 7f0d32d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.859+0000 7f0d32d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.859+0000 7f0d32d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.859+0000 7f0d32d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.859+0000 7f0d32d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.859+0000 7f0d32d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 10 monclient(hunting): handle_auth_done global_id 14327 payload 274 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 1 -- 172.21.15.116:0/2755555717 >> v1:172.21.15.173:6789/0 conn(0x7f0d3413faa0 legacy=0x7f0d34145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 1 -- 172.21.15.116:0/2755555717 >> v1:172.21.15.116:6789/0 conn(0x7f0d340a96e0 legacy=0x7f0d3413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 10 monclient: _finish_hunting 0 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 1 monclient: found mon.noname-b 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.862+0000 7f0d32d9d640 1 -- 172.21.15.116:0/2755555717 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d340aae80 con 0x7f0d340b1850 2024-01-23T07:33:40.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.865+0000 7f0d32d9d640 1 --2- 172.21.15.116:0/2755555717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d34145d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009dc0 tx=0x7f0d2c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ffff4f97a5a4829 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:40.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 1 -- 172.21.15.116:0/2755555717 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c02cc40 con 0x7f0d340b1850 2024-01-23T07:33:40.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: dump: 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.870 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: _finish_auth 0 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: _check_auth_tickets 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 1 -- 172.21.15.116:0/2755555717 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c02cda0 con 0x7f0d340b1850 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 1 -- 172.21.15.116:0/2755555717 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c034660 con 0x7f0d340b1850 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:40.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d31d9b640 10 monclient: dump: 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d38b4e640 5 monclient: authenticate success, global_id 14327 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d38b4e640 10 monclient: get_monmap_and_config success 2024-01-23T07:33:40.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.869+0000 7f0d38b4e640 4 set_mon_vals no callback set 2024-01-23T07:33:40.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 10 monclient: shutdown 2024-01-23T07:33:40.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:40.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 1 -- 172.21.15.116:0/2755555717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 msgr2=0x7f0d34145d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/2755555717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d34145d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c009dc0 tx=0x7f0d2c02be90 comp rx=0 tx=0).stop 2024-01-23T07:33:40.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 1 -- 172.21.15.116:0/2755555717 shutdown_connections 2024-01-23T07:33:40.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/2755555717 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d34145d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 1 -- 172.21.15.116:0/2755555717 >> 172.21.15.116:0/2755555717 conn(0x7f0d340b7bb0 msgr2=0x7f0d340b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 1 -- 172.21.15.116:0/2755555717 shutdown_connections 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.870+0000 7f0d38b4e640 1 -- 172.21.15.116:0/2755555717 wait complete. 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 10 monclient: build_initial_monmap 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 10 monclient: monmap: 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:33:40.877 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 1 librados: starting msgr at 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 1 librados: starting objecter 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 1 Processor -- start 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 1 -- start start 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 1 librados: setting wanted keys 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 1 librados: calling monclient init 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.871+0000 7f0d38b4e640 10 monclient: init 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient: _reopen_session rank -1 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:33:40.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d340a96e0 0x7f0d341db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): picked mon.noname-b con 0x7f0d340a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d3413ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): picked mon.noname-c con 0x7f0d340b1850 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d3413faa0 0x7f0d34142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): picked mon.noname-a con 0x7f0d3413faa0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d341453e0 con 0x7f0d3413faa0 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d341db3d0 con 0x7f0d340a96e0 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): start opening mon connection 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d34140440 con 0x7f0d340b1850 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): _renew_subs 2024-01-23T07:33:40.879 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d38b4e640 10 monclient(hunting): authenticate will time out at 2428.230452s 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d2bfff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d3413ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d3259c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d340a96e0 0x7f0d341db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d2bfff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d3413ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:36686/0 (socket says 172.21.15.116:36686) 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d2bfff640 1 -- 172.21.15.116:0/602295393 learned_addr learned my addr 172.21.15.116:0/602295393 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d2bfff640 10 monclient(hunting): get_auth_request con 0x7f0d340b1850 auth_method 0 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d2bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.872+0000 7f0d2bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d3259c640 10 monclient(hunting): get_auth_request con 0x7f0d340a96e0 auth_method 0 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d3259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:33:40.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d3259c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d3259c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d3259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d3259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.873+0000 7f0d3259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 10 monclient(hunting): handle_auth_done global_id 14330 payload 824 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 1 -- 172.21.15.116:0/602295393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d340a96e0 msgr2=0x7f0d341db8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d340a96e0 0x7f0d341db8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 1 -- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d3413faa0 msgr2=0x7f0d34142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d3413faa0 0x7f0d34142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 10 monclient: _finish_hunting 0 2024-01-23T07:33:40.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 1 monclient: found mon.noname-c 2024-01-23T07:33:40.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:33:40.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.876+0000 7f0d2bfff640 1 -- 172.21.15.116:0/602295393 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d2c009a70 con 0x7f0d340b1850 2024-01-23T07:33:40.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.879+0000 7f0d2bfff640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d3413ff00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c3c0 tx=0x7f0d1c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:40.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.879+0000 7f0d2affd640 10 client.?.objecter ms_handle_connect 0x7f0d340b1850 2024-01-23T07:33:40.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.879+0000 7f0d2affd640 10 client.?.objecter resend_mon_ops 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 1 -- 172.21.15.116:0/602295393 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c005d30 con 0x7f0d340b1850 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: dump: 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.885 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: _finish_auth 0 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: _check_auth_tickets 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 1 -- 172.21.15.116:0/602295393 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c005e90 con 0x7f0d340b1850 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 5 monclient: authenticate success, global_id 14330 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 10 monclient: _renew_subs 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d34142d80 con 0x7f0d340b1850 2024-01-23T07:33:40.886 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 1 -- 172.21.15.116:0/602295393 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0072f0 con 0x7f0d340b1850 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d2affd640 10 monclient: dump: 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T07:33:40.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d3159a640 4 set_mon_vals no callback set 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 10 client.14330.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 10 monclient: _renew_subs 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3413ed80 con 0x7f0d340b1850 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.884+0000 7f0d38b4e640 1 librados: init done 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.885+0000 7f0d38b4e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.885+0000 7f0d38b4e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.885+0000 7f0d38b4e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:40.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:40.885+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d34140600 con 0x7f0d340b1850 2024-01-23T07:33:41.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.175+0000 7f0d2affd640 1 -- 172.21.15.116:0/602295393 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f0d1c007450 con 0x7f0d340b1850 2024-01-23T07:33:41.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.175+0000 7f0d2affd640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f0d1406c8b0 0x7f0d1406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:33:41.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.175+0000 7f0d3259c640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f0d1406c8b0 0x7f0d1406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:33:41.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.175+0000 7f0d3259c640 10 monclient: get_auth_request con 0x7f0d1406c8b0 auth_method 0 2024-01-23T07:33:41.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.176+0000 7f0d3259c640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f0d1406c8b0 0x7f0d1406ed70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d240017f0 tx=0x7f0d24009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:33:41.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.176+0000 7f0d2affd640 10 client.14330.objecter ms_handle_connect 0x7f0d1406c8b0 2024-01-23T07:33:41.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.191+0000 7f0d2affd640 1 -- 172.21.15.116:0/602295393 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0d1c057bf0 con 0x7f0d340b1850 2024-01-23T07:33:41.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.191+0000 7f0d2affd640 10 client.14330.objecter ms_dispatch 0x7f0d34000b90 osd_map(24..24 src has 1..24) v4 2024-01-23T07:33:41.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.191+0000 7f0d2affd640 3 client.14330.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:33:41.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.191+0000 7f0d2affd640 3 client.14330.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:33:41.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.192+0000 7f0d2affd640 20 client.14330.objecter dump_active .. 0 homeless 2024-01-23T07:33:41.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.192+0000 7f0d2affd640 1 -- 172.21.15.116:0/602295393 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f0d1c053f30 con 0x7f0d340b1850 2024-01-23T07:33:41.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.192+0000 7f0d2affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T07:33:41.193 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.192+0000 7f0d2affd640 10 monclient: _finish_command 1 = system:0 2024-01-23T07:33:41.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.400+0000 7f0d38b4e640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-01-23T07:33:41.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.400+0000 7f0d38b4e640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-01-23T07:33:41.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.400+0000 7f0d38b4e640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T07:33:41.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.400+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0d34067d70 con 0x7f0d340b1850 2024-01-23T07:33:41.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.405+0000 7f0d2affd640 1 -- 172.21.15.116:0/602295393 <== mon.2 v2:172.21.15.116:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0d1c017080 con 0x7f0d340b1850 2024-01-23T07:33:41.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.405+0000 7f0d2affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-01-23T07:33:41.406 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.405+0000 7f0d2affd640 10 monclient: _finish_command 2 = system:0 2024-01-23T07:33:41.406 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T07:33:41.407 INFO:teuthology.orchestra.run.smithi116.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-23T07:33:41.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 10 librados: watch_flush enter 2024-01-23T07:33:41.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 10 librados: watch_flush exit 2024-01-23T07:33:41.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 20 client.14330.objecter shutdown clearing up homeless session... 2024-01-23T07:33:41.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 10 client.14330.objecter successfully canceled tick 2024-01-23T07:33:41.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f0d1406c8b0 msgr2=0x7f0d1406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:41.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f0d1406c8b0 0x7f0d1406ed70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0d240017f0 tx=0x7f0d24009040 comp rx=0 tx=0).stop 2024-01-23T07:33:41.409 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 10 monclient: shutdown 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 msgr2=0x7f0d3413ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d3413ff00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00c3c0 tx=0x7f0d1c00c880 comp rx=0 tx=0).stop 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 shutdown_connections 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f0d1406c8b0 0x7f0d1406ed70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d3413faa0 0x7f0d34142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f0d340b1850 0x7f0d3413ff00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 --2- 172.21.15.116:0/602295393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d340a96e0 0x7f0d341db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 >> 172.21.15.116:0/602295393 conn(0x7f0d340b7bb0 msgr2=0x7f0d34145850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 shutdown_connections 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 -- 172.21.15.116:0/602295393 wait complete. 2024-01-23T07:33:41.410 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T07:33:41.408+0000 7f0d38b4e640 1 librados: shutdown 2024-01-23T07:33:41.420 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-23T07:33:41.420 INFO:teuthology.run_tasks:Running task workunit... 2024-01-23T07:33:41.438 INFO:tasks.workunit:Pulling workunits from ref 1d1563036928048a487b8d17bdf66baca01c75bf 2024-01-23T07:33:41.439 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-23T07:33:41.439 DEBUG:teuthology.orchestra.run.smithi116:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-23T07:33:41.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T07:33:41.454 INFO:teuthology.orchestra.run.smithi116.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-01-23T07:33:41.454 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-01-23T07:33:41.508 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-01-23T07:33:41.509 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-01-23T07:33:41.563 INFO:tasks.workunit:timeout=6h 2024-01-23T07:33:41.564 INFO:tasks.workunit:cleanup=True 2024-01-23T07:33:41.564 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1d1563036928048a487b8d17bdf66baca01c75bf 2024-01-23T07:33:41.619 INFO:tasks.workunit.client.0.smithi116.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-23T07:33:45.836 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:34.215 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.838 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:34.218 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.874 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:34.253 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.885 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:34.221 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.887 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:34.266 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.887 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:34.223 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.888 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:34.268 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.924 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:34.260 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:33:45.925 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:34.305 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.873 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:54.252 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.877 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:54.256 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.898 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:01:54.278 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.926 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:54.262 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.928 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:54.264 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.937 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:54.316 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.940 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:54.320 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.943 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:01:54.279 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:05.956 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:01:54.336 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.918 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:14.296 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.920 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:14.299 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.941 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:14.321 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.970 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:14.306 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.971 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:14.308 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.985 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:14.321 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.994 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:14.374 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:25.999 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:14.378 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:26.019 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:14.399 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.032 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:34.409 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.033 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:34.413 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.037 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:34.416 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.038 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:34.418 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.066 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:34.446 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.091 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:34.427 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.092 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:34.428 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.106 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:34.442 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:46.113 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:34.492 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:34:52.267 INFO:tasks.workunit.client.0.smithi116.stderr:Note: switching to '1d1563036928048a487b8d17bdf66baca01c75bf'. 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr:state without impacting any branches by switching back to a branch. 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr: git switch -c 2024-01-23T07:34:52.268 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-01-23T07:34:52.269 INFO:tasks.workunit.client.0.smithi116.stderr:Or undo this operation with: 2024-01-23T07:34:52.269 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-01-23T07:34:52.269 INFO:tasks.workunit.client.0.smithi116.stderr: git switch - 2024-01-23T07:34:52.269 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-01-23T07:34:52.269 INFO:tasks.workunit.client.0.smithi116.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-23T07:34:52.269 INFO:tasks.workunit.client.0.smithi116.stderr: 2024-01-23T07:34:52.269 INFO:tasks.workunit.client.0.smithi116.stderr:HEAD is now at 1d156303692 Merge branch 'wip-ksirivad-fix-63861' of https://github.com/kamoltat/ceph into wip-yuri7-testing-2024-01-18-1327 2024-01-23T07:34:52.270 DEBUG:teuthology.orchestra.run.smithi116:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-23T07:34:52.338 INFO:tasks.workunit.client.0.smithi116.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-23T07:34:52.340 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-23T07:34:52.340 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-23T07:34:52.977 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-23T07:34:53.045 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-23T07:34:53.086 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-23T07:34:53.087 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-23T07:34:53.087 INFO:tasks.workunit.client.0.smithi116.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-23T07:34:53.127 INFO:tasks.workunit.client.0.smithi116.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-23T07:34:53.130 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2024-01-23T07:34:53.130 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-23T07:34:53.185 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-01-23T07:34:53.186 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-01-23T07:34:53.187 DEBUG:teuthology.orchestra.run.smithi116:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d1563036928048a487b8d17bdf66baca01c75bf TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ parallel=1 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' '' = --serial ']' 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ crimson=0 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' '' = --crimson ']' 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ color= 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -t 1 ']' 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ declare -A pids 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.246 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.247 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_aio 2024-01-23T07:34:53.247 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_aio' 2024-01-23T07:34:53.247 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_aio 2024-01-23T07:34:53.247 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.247 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_aio 2024-01-23T07:34:53.247 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40449 2024-01-23T07:34:53.248 INFO:tasks.workunit.client.0.smithi116.stdout:test api_aio on pid 40449 2024-01-23T07:34:53.251 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_aio on pid 40449' 2024-01-23T07:34:53.251 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40449 2024-01-23T07:34:53.251 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.251 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.251 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-01-23T07:34:53.251 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_aio_pp 2024-01-23T07:34:53.251 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_aio_pp' 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_aio_pp 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.252 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.253 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.254 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.254 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.254 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_aio_pp 2024-01-23T07:34:53.254 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40456 2024-01-23T07:34:53.254 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_aio_pp on pid 40456' 2024-01-23T07:34:53.254 INFO:tasks.workunit.client.0.smithi116.stdout:test api_aio_pp on pid 40456 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40456 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_io 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_io' 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_io 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.259 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.260 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.261 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.262 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.263 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.263 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.263 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.263 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_io 2024-01-23T07:34:53.263 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40465 2024-01-23T07:34:53.263 INFO:tasks.workunit.client.0.smithi116.stdout:test api_io on pid 40465 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_io on pid 40465' 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40465 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_io_pp 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_io_pp' 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_io_pp 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.268 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.269 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.270 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.271 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.272 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.273 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.273 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.273 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.273 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_io_pp 2024-01-23T07:34:53.273 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40477 2024-01-23T07:34:53.273 INFO:tasks.workunit.client.0.smithi116.stdout:test api_io_pp on pid 40477 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_io_pp on pid 40477' 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40477 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_asio 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_asio' 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_asio 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.279 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.280 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.281 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.282 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.283 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.284 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.285 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.286 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.286 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_asio 2024-01-23T07:34:53.286 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40494 2024-01-23T07:34:53.286 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_asio on pid 40494' 2024-01-23T07:34:53.286 INFO:tasks.workunit.client.0.smithi116.stdout:test api_asio on pid 40494 2024-01-23T07:34:53.293 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40494 2024-01-23T07:34:53.293 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.293 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.293 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-01-23T07:34:53.293 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_list 2024-01-23T07:34:53.293 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_list' 2024-01-23T07:34:53.293 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_list 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.294 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.295 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.296 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.297 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.298 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40449/exe 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.299 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.300 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_list 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40509 2024-01-23T07:34:53.301 INFO:tasks.workunit.client.0.smithi116.stdout:test api_list on pid 40509 2024-01-23T07:34:53.311 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_list on pid 40509' 2024-01-23T07:34:53.311 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40509 2024-01-23T07:34:53.311 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.311 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.311 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-01-23T07:34:53.311 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.311 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_lock 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_lock' 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.312 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_lock 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.313 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.314 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.315 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.316 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_aio.log 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.317 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.318 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.319 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_aio: /' 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.320 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40456/exe 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_lock 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40529 2024-01-23T07:34:53.321 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_lock on pid 40529' 2024-01-23T07:34:53.322 INFO:tasks.workunit.client.0.smithi116.stdout:test api_lock on pid 40529 2024-01-23T07:34:53.332 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40529 2024-01-23T07:34:53.332 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.332 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.332 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.332 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.332 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_lock_pp 2024-01-23T07:34:53.332 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_lock_pp' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.333 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_lock_pp 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.334 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.335 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.336 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.337 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.338 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40465/exe 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.339 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.340 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_aio_pp: /' 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.341 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_lock_pp 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40550 2024-01-23T07:34:53.342 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.343 INFO:tasks.workunit.client.0.smithi116.stdout:test api_lock_pp on pid 40550 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_lock_pp on pid 40550' 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40550 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_misc 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.351 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_io.log 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_misc' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_misc 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.352 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.353 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.354 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.355 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.356 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40477/exe 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.357 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.358 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_misc 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_io: /' 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40568 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.359 INFO:tasks.workunit.client.0.smithi116.stdout:test api_misc on pid 40568 2024-01-23T07:34:53.366 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_misc on pid 40568' 2024-01-23T07:34:53.366 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40568 2024-01-23T07:34:53.366 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.366 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.366 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_misc_pp 2024-01-23T07:34:53.366 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.367 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_misc_pp' 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.368 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.369 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_io_pp: /' 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.370 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_misc_pp 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_misc_pp 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.371 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40583 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.372 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_misc_pp on pid 40583' 2024-01-23T07:34:53.373 INFO:tasks.workunit.client.0.smithi116.stdout:test api_misc_pp on pid 40583 2024-01-23T07:34:53.379 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40583 2024-01-23T07:34:53.379 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.379 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.379 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.379 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.379 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.379 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_tier_pp 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.380 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_tier_pp' 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.381 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_tier_pp 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.382 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40509/exe 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.383 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.384 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_tier_pp 2024-01-23T07:34:53.385 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40597 2024-01-23T07:34:53.386 INFO:tasks.workunit.client.0.smithi116.stdout:test api_tier_pp on pid 40597 2024-01-23T07:34:53.395 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_tier_pp on pid 40597' 2024-01-23T07:34:53.395 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40597 2024-01-23T07:34:53.395 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.396 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.397 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_pool 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_pool' 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_list.log 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.398 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.399 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_pool 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.400 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40494/exe 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40529/exe 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.401 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.402 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.403 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.404 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.404 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_asio.log 2024-01-23T07:34:53.404 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2024-01-23T07:34:53.404 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_lock.log 2024-01-23T07:34:53.404 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_pool 2024-01-23T07:34:53.404 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40619 2024-01-23T07:34:53.404 INFO:tasks.workunit.client.0.smithi116.stdout:test api_pool on pid 40619 2024-01-23T07:34:53.416 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_pool on pid 40619' 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40619 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_snapshots 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_snapshots' 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.417 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.418 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.419 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.420 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_list: /' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.421 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_asio: /' 2024-01-23T07:34:53.422 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_lock: /' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.423 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_snapshots 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.424 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.425 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.426 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_snapshots 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40650 2024-01-23T07:34:53.427 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.428 INFO:tasks.workunit.client.0.smithi116.stdout:test api_snapshots on pid 40650 2024-01-23T07:34:53.431 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_snapshots on pid 40650' 2024-01-23T07:34:53.431 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40650 2024-01-23T07:34:53.431 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.431 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.431 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.431 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.431 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_snapshots_pp 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_snapshots_pp' 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.432 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_snapshots_pp 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.433 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_snapshots_pp 2024-01-23T07:34:53.434 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40672 2024-01-23T07:34:53.434 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_snapshots_pp on pid 40672' 2024-01-23T07:34:53.435 INFO:tasks.workunit.client.0.smithi116.stdout:test api_snapshots_pp on pid 40672 2024-01-23T07:34:53.439 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40672 2024-01-23T07:34:53.439 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.439 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_stat 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_stat' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.440 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_stat 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.441 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.442 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_stat 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40683 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_stat on pid 40683' 2024-01-23T07:34:53.443 INFO:tasks.workunit.client.0.smithi116.stdout:test api_stat on pid 40683 2024-01-23T07:34:53.449 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40683 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.450 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_stat_pp 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_stat_pp' 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.451 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.452 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_stat_pp 2024-01-23T07:34:53.453 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_stat_pp 2024-01-23T07:34:53.454 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.455 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.455 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40698 2024-01-23T07:34:53.455 INFO:tasks.workunit.client.0.smithi116.stdout:test api_stat_pp on pid 40698 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_stat_pp on pid 40698' 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40698 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.468 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_watch_notify 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-01-23T07:34:53.469 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_watch_notify' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.470 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.471 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.472 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_watch_notify 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.473 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.474 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.475 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.476 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.477 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.478 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40550/exe 2024-01-23T07:34:53.479 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_watch_notify 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40722 2024-01-23T07:34:53.480 INFO:tasks.workunit.client.0.smithi116.stdout:test api_watch_notify on pid 40722 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_watch_notify on pid 40722' 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40722 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40568/exe 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.494 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.495 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40583/exe 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_watch_notify_pp 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.496 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.497 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.498 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_watch_notify_pp' 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.499 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_lock_pp: /' 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.500 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.501 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.502 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_watch_notify_pp 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.503 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_misc: /' 2024-01-23T07:34:53.504 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_misc.log 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.505 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.506 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.506 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.506 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.506 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2024-01-23T07:34:53.506 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_watch_notify_pp 2024-01-23T07:34:53.506 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40776 2024-01-23T07:34:53.506 INFO:tasks.workunit.client.0.smithi116.stdout:test api_watch_notify_pp on pid 40776 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_watch_notify_pp on pid 40776' 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40776 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.525 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.526 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_misc_pp: /' 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.527 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.528 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.529 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.530 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.531 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_cmd 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_cmd' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.532 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40597/exe 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.533 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.534 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2024-01-23T07:34:53.535 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.536 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.537 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_tier_pp: /' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.538 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.539 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.540 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40672/exe 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_cmd 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.541 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_cmd 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.542 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40832 2024-01-23T07:34:53.543 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_cmd on pid 40832' 2024-01-23T07:34:53.544 INFO:tasks.workunit.client.0.smithi116.stdout:test api_cmd on pid 40832 2024-01-23T07:34:53.558 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40832 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_cmd_pp 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_cmd_pp' 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.559 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.560 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.561 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.562 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.563 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.564 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.565 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.566 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.567 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_cmd_pp 2024-01-23T07:34:53.568 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.569 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.570 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.571 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.572 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.572 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.572 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_cmd_pp 2024-01-23T07:34:53.572 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40882 2024-01-23T07:34:53.572 INFO:tasks.workunit.client.0.smithi116.stdout:test api_cmd_pp on pid 40882 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_cmd_pp on pid 40882' 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40882 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.594 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.595 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.596 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.597 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40650/exe 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.598 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.599 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.600 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40619/exe 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.601 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.602 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.603 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40698/exe 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.604 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.605 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_service 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_service' 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.606 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_snapshots: /' 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.607 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_pool: /' 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.608 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_pool.log 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.609 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_stat_pp: /' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.610 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_service 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.611 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.612 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40722/exe 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_service 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40930 2024-01-23T07:34:53.613 INFO:tasks.workunit.client.0.smithi116.stdout:test api_service on pid 40930 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_service on pid 40930' 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40930 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-01-23T07:34:53.620 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.621 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40683/exe 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.622 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.623 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.624 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_watch_notify: /' 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [----------] Global test environment set-up. 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [----------] 12 tests from AsioRados 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.429+0000 7fbc05435780 10 monclient: get_monmap_and_config 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.429+0000 7fbc05435780 10 monclient: build_initial_monmap 2024-01-23T07:34:53.625 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.429+0000 7fbc05435780 10 monclient: monmap: 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: epoch 0 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: last_changed 0.000000 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: created 0.000000 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: min_mon_release 0 (unknown) 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: election_strategy: 1 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.429+0000 7fbc05435780 1 Processor -- start 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.429+0000 7fbc05435780 1 -- start start 2024-01-23T07:34:53.626 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.429+0000 7fbc05435780 10 monclient: init 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient: _reopen_session rank -1 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d698c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): picked mon.noname-b con 0x56500d5fedb0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d6934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): picked mon.noname-c con 0x56500d6058c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56500d69eca0 0x56500d608080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): picked mon.noname-a con 0x56500d69eca0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): start opening mon connection 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500d5841f0 con 0x56500d69eca0 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): start opening mon connection 2024-01-23T07:34:53.627 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500d57fae0 con 0x56500d5fedb0 2024-01-23T07:34:53.628 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): start opening mon connection 2024-01-23T07:34:53.628 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56500d53bab0 con 0x56500d6058c0 2024-01-23T07:34:53.628 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): _renew_subs 2024-01-23T07:34:53.628 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.430+0000 7fbc05435780 10 monclient(hunting): authenticate will time out at 2500.789000s 2024-01-23T07:34:53.630 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.630 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.630 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.630 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.630 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.630 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_service_pp 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_service_pp' 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_service_pp 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.631 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.632 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_stat.log 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_stat: /' 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_service_pp 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40973 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.633 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_service_pp on pid 40973' 2024-01-23T07:34:53.634 INFO:tasks.workunit.client.0.smithi116.stdout: test api_service_pp on pid 40973 2024-01-23T07:34:53.647 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=40973 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.648 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.649 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.650 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_c_write_operations 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_c_write_operations' 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.651 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_c_write_operations 2024-01-23T07:34:53.652 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.653 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.654 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40776/exe 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.655 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.656 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.657 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.658 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_c_write_operations 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41014 2024-01-23T07:34:53.659 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_c_write_operations on pid 41014' 2024-01-23T07:34:53.660 INFO:tasks.workunit.client.0.smithi116.stdout:test api_c_write_operations on pid 41014 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41014 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.670 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.671 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.672 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.673 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_c_read_operations 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_c_read_operations' 2024-01-23T07:34:53.674 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40882/exe 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_c_read_operations 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.675 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.676 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.677 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.678 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_c_read_operations 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41044 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_c_read_operations on pid 41044' 2024-01-23T07:34:53.679 INFO:tasks.workunit.client.0.smithi116.stdout:test api_c_read_operations on pid 41044 2024-01-23T07:34:53.691 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41044 2024-01-23T07:34:53.691 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.691 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.691 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.691 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s api_cls_remote_reads 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' api_cls_remote_reads' 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.692 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.693 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.694 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.695 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40930/exe 2024-01-23T07:34:53.696 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.697 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.698 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.699 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.700 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.701 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.702 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.433+0000 7fbc01c4b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d6934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d6934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:46904/0 (socket says 172.21.15.116:46904) 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 1 -- 172.21.15.116:0/2369320110 learned_addr learned my addr 172.21.15.116:0/2369320110 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 10 monclient(hunting): get_auth_request con 0x56500d6058c0 auth_method 0 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:34:53.703 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.434+0000 7fbc01c4b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 10 monclient(hunting): handle_auth_done global_id 14354 payload 274 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 1 -- 172.21.15.116:0/2369320110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 msgr2=0x56500d698c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 1 --2- 172.21.15.116:0/2369320110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d698c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 1 -- 172.21.15.116:0/2369320110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56500d69eca0 msgr2=0x56500d608080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 1 --2- 172.21.15.116:0/2369320110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56500d69eca0 0x56500d608080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 10 monclient: _finish_hunting 0 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 1 monclient: found mon.noname-c 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T07:34:53.704 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.436+0000 7fbc01c4b640 1 -- 172.21.15.116:0/2369320110 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc00a1c0 con 0x56500d6058c0 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.445+0000 7fbc01c4b640 1 --2- 172.21.15.116:0/2369320110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d6934b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800a590 tx=0x7fbbf800aa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88de6457dda46160 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 1 -- 172.21.15.116:0/2369320110 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf800b980 con 0x56500d6058c0 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: dump: 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: epoch 1 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: min_mon_release 19 (squid) 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: election_strategy: 1 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:34:53.705 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: _finish_auth 0 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: _check_auth_tickets 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 1 -- 172.21.15.116:0/2369320110 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf800bb00 con 0x56500d6058c0 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 1 -- 172.21.15.116:0/2369320110 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8014470 con 0x56500d6058c0 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc00c49640 10 monclient: dump: 2024-01-23T07:34:53.706 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: epoch 1 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: min_mon_release 19 (squid) 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: election_strategy: 1 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc05435780 5 monclient: authenticate success, global_id 14354 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc05435780 10 monclient: get_monmap_and_config success 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.493+0000 7fbc05435780 4 set_mon_vals no callback set 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 10 monclient: shutdown 2024-01-23T07:34:53.707 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:34:53.708 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 1 -- 172.21.15.116:0/2369320110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 msgr2=0x56500d6934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:34:53.711 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.711 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.711 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.712 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.713 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.714 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 1 --2- 172.21.15.116:0/2369320110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d6934b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800a590 tx=0x7fbbf800aa50 comp rx=0 tx=0).stop 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 1 -- 172.21.15.116:0/2369320110 shutdown_connections 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 1 --2- 172.21.15.116:0/2369320110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56500d69eca0 0x56500d608080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 1 --2- 172.21.15.116:0/2369320110 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d6934b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 1 --2- 172.21.15.116:0/2369320110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d698c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.494+0000 7fbc05435780 1 -- 172.21.15.116:0/2369320110 >> 172.21.15.116:0/2369320110 conn(0x56500d605cf0 msgr2=0x56500d6982e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.495+0000 7fbc05435780 1 -- 172.21.15.116:0/2369320110 shutdown_connections 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.495+0000 7fbc05435780 1 -- 172.21.15.116:0/2369320110 wait complete. 2024-01-23T07:34:53.715 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.495+0000 7fbc05435780 10 monclient: build_initial_monmap 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.495+0000 7fbc05435780 10 monclient: monmap: 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: epoch 0 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: last_changed 0.000000 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: created 0.000000 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: min_mon_release 0 (unknown) 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: election_strategy: 1 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.495+0000 7fbc05435780 1 librados: starting msgr at 2024-01-23T07:34:53.716 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.495+0000 7fbc05435780 1 librados: starting objecter 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.495+0000 7fbc05435780 1 Processor -- start 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 -- start start 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 librados: setting wanted keys 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 librados: calling monclient init 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient: init 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient: _reopen_session rank -1 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d692870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): picked mon.noname-b con 0x56500d5fedb0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d691b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:53.717 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): picked mon.noname-c con 0x56500d6058c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40973/exe 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.726 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.727 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.728 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-01-23T07:34:53.729 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_service_pp: /' 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_service.log 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_service: /' 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.730 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo api_cls_remote_reads 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2024-01-23T07:34:53.731 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=api_cls_remote_reads 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.732 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41107 2024-01-23T07:34:53.733 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 --2- >> [v2:172.21.15.116:3300/0test api_cls_remote_reads on pid 41107 2024-01-23T07:34:53.738 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test api_cls_remote_reads on pid 41107' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41107 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.739 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41014/exe 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.740 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/40832/exe 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s list_parallel 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' list_parallel' 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.741 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_cmd.log 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo list_parallel 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=list_parallel 2024-01-23T07:34:53.742 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41130 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test list_parallel on pid 41130' 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.743 INFO:tasks.workunit.client.0.smithi116.stdout:test list_parallel on pid 41130 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41130 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s open_pools_parallel 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' open_pools_parallel' 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo open_pools_parallel 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.747 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.748 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.749 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=open_pools_parallel 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41159 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test open_pools_parallel on pid 41159' 2024-01-23T07:34:53.750 INFO:tasks.workunit.client.0.smithi116.stdout:test open_pools_parallel on pid 41159 2024-01-23T07:34:53.752 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41159 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_cmd: /' 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s delete_pools_parallel 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' delete_pools_parallel' 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.753 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo delete_pools_parallel 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stdout:,v1:172.21.15.116:6789/0] conn(0x56500d69eca0 0x56500d5c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): picked mon.noname-a con 0x56500d69eca0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): start opening mon connection 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500d53b750 con 0x56500d69eca0 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): start opening mon connection 2024-01-23T07:34:53.754 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x56500d4f8520 con 0x56500d5fedb0 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): start opening mon connection 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x56500d5cab90 con 0x56500d6058c0 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): _renew_subs 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.496+0000 7fbc05435780 10 monclient(hunting): authenticate will time out at 2500.855063s 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.519+0000 7fbc0244c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d692870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.523+0000 7fbc0244c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d692870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:44236/0 (socket says 172.21.15.116:44236) 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.523+0000 7fbc0244c640 1 -- 172.21.15.116:0/1263817588 learned_addr learned my addr 172.21.15.116:0/1263817588 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.523+0000 7fbc0244c640 10 monclient(hunting): get_auth_request con 0x56500d5fedb0 auth_method 0 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.523+0000 7fbc0244c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.523+0000 7fbc0244c640 10 monclient(hunting): _init_auth method 2 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.523+0000 7fbc0244c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T07:34:53.755 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.531+0000 7fbc0244c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T07:34:53.756 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.531+0000 7fbc0244c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T07:34:53.756 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.531+0000 7fbc0244c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T07:34:53.756 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 10 monclient(hunting): handle_auth_done global_id 4471 payload 824 2024-01-23T07:34:53.756 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 1 -- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 msgr2=0x56500d691b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:34:53.756 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x56500d6058c0 0x56500d691b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:34:53.756 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.757 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.757 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=delete_pools_parallel 2024-01-23T07:34:53.757 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41183 2024-01-23T07:34:53.757 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.757 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 1 -- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:3300/0,v1:172.2test delete_pools_parallel on pid 41183 2024-01-23T07:34:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test delete_pools_parallel on pid 41183' 2024-01-23T07:34:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41183 2024-01-23T07:34:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.776 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.777 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.778 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.779 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41044/exe 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.780 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.781 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.782 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.783 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.784 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.785 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s cls 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' cls' 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.786 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo cls 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.787 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.788 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.789 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.790 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.791 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.792 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.793 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.794 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.795 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=cls 2024-01-23T07:34:53.796 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41239 2024-01-23T07:34:53.796 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test cls on pid 41239' 2024-01-23T07:34:53.796 INFO:tasks.workunit.client.0.smithi116.stdout:test cls on pid 41239 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41239 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.804 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.805 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.806 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41107/exe 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.807 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.808 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.809 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-01-23T07:34:53.810 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout:1.15.116:6789/0] conn(0x56500d69eca0 msgr2=0x56500d5c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56500d69eca0 0x56500d5c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 10 monclient: _finish_hunting 0 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 1 monclient: found mon.noname-b 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.537+0000 7fbc0244c640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8005d40 con 0x56500d5fedb0 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.547+0000 7fbc0244c640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d692870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400ba80 tx=0x7fbbf400bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.547+0000 7fbbf37fe640 10 client.?.objecter ms_handle_connect 0x56500d5fedb0 2024-01-23T07:34:53.811 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.547+0000 7fbbf37fe640 10 client.?.objecter resend_mon_ops 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4009b30 con 0x56500d5fedb0 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: dump: 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: epoch 1 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: min_mon_release 19 (squid) 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: election_strategy: 1 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:34:53.812 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: _finish_auth 0 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: _check_auth_tickets 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4008030 con 0x56500d5fedb0 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400f400 con 0x56500d5fedb0 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T07:34:53.813 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbbf37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T07:34:53.822 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.822 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.822 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.822 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.822 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41159/exe 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s cmd 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' cmd' 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo cmd 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.823 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.824 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.825 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.826 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.827 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.828 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=cmd 2024-01-23T07:34:53.829 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.830 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41305 2024-01-23T07:34:53.830 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test cmd on pid 41305' 2024-01-23T07:34:53.830 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-01-23T07:34:53.830 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000test cmd on pid 41305 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41305 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.841 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s handler_error 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.842 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' handler_error' 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.843 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo handler_error 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.844 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.845 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.847 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.847 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.847 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.848 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.849 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.850 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.851 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=handler_error 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.852 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41321 2024-01-23T07:34:53.853 INFO:tasks.workunit.client.0.smithi116.stdout:test handler_error on pid 41321 2024-01-23T07:34:53.866 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test handler_error on pid 41321' 2024-01-23T07:34:53.866 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41321 2024-01-23T07:34:53.866 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.866 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.866 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.866 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s io 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' io' 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41130/exe 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.867 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41183/exe 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.868 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.869 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.870 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ list_parallel: /' 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.871 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_list_parallel.log 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.872 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.873 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.874 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.875 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.876 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo io 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.877 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=io 2024-01-23T07:34:53.878 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.878 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.878 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41358 2024-01-23T07:34:53.878 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test io on pid 41358' 2024-01-23T07:34:53.878 INFO:tasks.workunit.client.0.smithi116.stdout:test io on pid 41358 2024-01-23T07:34:53.889 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41358 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s ec_io 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.890 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' ec_io' 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41239/exe 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.891 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.892 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.893 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.894 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_cls.log 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ cls: /' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.895 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.896 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.897 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo ec_io 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.898 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stdout: 7fbbf37fe640 10 monclient: dump: 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: epoch 1 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: created 2024-01-23T07:31:38.694528+0000 2024-01-23T07:34:53.899 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: min_mon_release 19 (squid) 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: election_strategy: 1 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 5 monclient: authenticate success, global_id 4471 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 10 monclient: _renew_subs 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56500d518010 con 0x56500d5fedb0 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 10 monclient: _renew_subs 2024-01-23T07:34:53.900 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56500d517a70 con 0x56500d5fedb0 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 1 librados: init done 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc05435780 10 librados: wait_for_osdmap waiting 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.573+0000 7fbc00c49640 4 set_mon_vals no callback set 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.638+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbbf400f560 con 0x56500d5fedb0 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.642+0000 7fbbf37fe640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbbe406ab50 0x7fbbe406d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.642+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbbf40877d0 con 0x56500d5fedb0 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.642+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(24..24 src has 1..24) v4 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.642+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [24,24] > 0 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.642+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding full epoch 24 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.642+0000 7fbc01c4b640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbbe406ab50 0x7fbbe406d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:34:53.901 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.643+0000 7fbc01c4b640 10 monclient: get_auth_request con 0x7fbbe406ab50 auth_method 0 2024-01-23T07:34:53.904 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.904 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.904 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.904 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.904 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.904 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_cls 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.905 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.906 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.907 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=ec_io 2024-01-23T07:34:53.907 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41407 2024-01-23T07:34:53.907 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test ec_io on pid 41407' 2024-01-23T07:34:53.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.644+0000 7fbc01c4b640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbbe406ab50 0x7fbbe406d010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800a590 tx=0x7fbbf800d000 cotest ec_io on pid 41407 2024-01-23T07:34:53.918 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41407 2024-01-23T07:34:53.918 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.918 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.918 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-01-23T07:34:53.918 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41321/exe 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.919 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.920 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_handler_error 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s list 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.921 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.922 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' list' 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.923 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.924 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ handler_error: /' 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_handler_error.log 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41305/exe 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.925 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.926 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_cmd 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ cmd: /' 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.927 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_cmd.log 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo list 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=list 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41477 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test list on pid 41477' 2024-01-23T07:34:53.928 INFO:tasks.workunit.client.0.smithi116.stdout:test list on pid 41477 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41477 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s ec_list 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' ec_list' 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo ec_list 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.931 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=ec_list 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41489 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test ec_list on pid 41489' 2024-01-23T07:34:53.932 INFO:tasks.workunit.client.0.smithi116.stdout:test ec_list on pid 41489 2024-01-23T07:34:53.939 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41489 2024-01-23T07:34:53.939 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.939 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.939 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s misc 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' misc' 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.940 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.941 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo misc 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.942 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:53.943 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.944 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=misc 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41509 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.945 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.946 INFO:tasks.workunit.client.0.smithi116.stdout:test misc on pid 41509 2024-01-23T07:34:53.949 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test misc on pid 41509' 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41509 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s pool 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' pool' 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo pool 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.950 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.951 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41358/exe 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=pool 2024-01-23T07:34:53.952 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41520 2024-01-23T07:34:53.953 INFO:tasks.workunit.client.0.smithi116.stdout:test pool on pid 41520 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test pool on pid 41520' 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41520 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s read_operations 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' read_operations' 2024-01-23T07:34:53.963 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.964 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.965 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:53.966 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.967 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:53.968 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo read_operations 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.969 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.970 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_io 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ io: /' 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_io.log 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.971 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=read_operations 2024-01-23T07:34:53.972 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41552 2024-01-23T07:34:53.972 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test read_operations on pid 41552' 2024-01-23T07:34:53.972 INFO:tasks.workunit.client.0.smithi116.stdout:test read_operations on pid 41552 2024-01-23T07:34:53.977 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41552 2024-01-23T07:34:53.977 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.977 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.977 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s snapshots 2024-01-23T07:34:53.977 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' snapshots' 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo snapshots 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:53.978 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:53.979 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41407/exe 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:53.980 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=snapshots 2024-01-23T07:34:53.981 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41564 2024-01-23T07:34:53.982 INFO:tasks.workunit.client.0.smithi116.stdout:test snapshots on pid 41564 2024-01-23T07:34:53.997 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test snapshots on pid 41564' 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41564 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:53.998 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:53.999 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.000 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:54.001 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s watch_notify 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' watch_notify' 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.002 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ ec_io: /' 2024-01-23T07:34:54.003 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_ec_io 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.004 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:54.005 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:54.006 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo watch_notify 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:54.007 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.008 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.009 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_ec_io.log 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:54.010 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.011 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.012 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41477/exe 2024-01-23T07:34:54.013 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=watch_notify 2024-01-23T07:34:54.014 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41621 2024-01-23T07:34:54.014 INFO:tasks.workunit.client.0.smithi116.stdout:test watch_notify on pid 41621 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test watch_notify on pid 41621' 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41621 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:++ printf %25s write_operations 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:54.025 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:+ r=' write_operations' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.026 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.027 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.028 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.029 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_list 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:++ awk '{print $1}' 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_list.log 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:++ echo write_operations 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:54.030 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ list: /' 2024-01-23T07:34:54.031 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:54.032 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.033 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:54.034 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:+ ff=write_operations 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41649 2024-01-23T07:34:54.035 INFO:tasks.workunit.client.0.smithi116.stdout:test write_operations on pid 41649 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+ echo 'test write_operations on pid 41649' 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+ pids[$f]=41649 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+ ret=0 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' 1 -eq 1 ']' 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40597 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40597 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.075 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.076 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.077 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.078 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41520/exe 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.079 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.080 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:54.081 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41489/exe 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:54.082 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.083 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.084 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -f /etc/bashrc ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+ . /etc/bashrc 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.085 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -z '' ']' 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ BASHRCSOURCED=Y 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ shopt -q login_shell 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.086 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+++ umask 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' 0022 -eq 0 ']' 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:++ SHELL=/bin/bash 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.087 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/bash_completion.sh 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_ec_list 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ ec_list: /' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.088 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/cobbler.sh 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorgrep.sh 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_pool 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_ec_list.log 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:54.089 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.090 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.091 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.092 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41564/exe 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.093 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'grep=grep --color=auto' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_pool.log 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'egrep=egrep --color=auto' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.094 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorls.sh 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' '!' -t 0 ']' 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:+++ return 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export S_COLORS=auto 2024-01-23T07:34:54.095 INFO:tasks.workunit.client.0.smithi116.stderr:+++ S_COLORS=auto 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.096 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_snapshots.log 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.097 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_snapshots 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41552/exe 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:54.098 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ pool: /' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.099 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.100 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ snapshots: /' 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_read_operations 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_read_operations.log 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41509/exe 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-01-23T07:34:54.101 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:+++ /usr/libexec/grepconf.sh -c 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.102 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/debuginfod.sh 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/gawk.sh 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/lang.sh 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/locale 2024-01-23T07:34:54.103 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ read_operations: /' 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.104 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG_backup=en_US.UTF-8 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /etc/locale.conf ']' 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_misc 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -x /usr/bin/sed ']' 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.105 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.106 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_misc.log 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ misc: /' 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:++++ export LANG=en_US.UTF-8 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:++++ LANG=en_US.UTF-8 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ LANG=en_US.UTF-8 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ unset LANG_backup config 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n '' ']' 2024-01-23T07:34:54.107 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' dumb = linux ']' 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/less.sh 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ for i in /etc/profile.d/*.sh 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ '[' '' ']' 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:++ . /etc/profile.d/which2.sh 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41621/exe 2024-01-23T07:34:54.108 INFO:tasks.workunit.client.0.smithi116.stderr:+++++ readlink /proc/41649/exe 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:++++ basename /usr/bin/bash 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.109 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_watch_notify 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_declare='declare -f' 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+++ which_opt=-f 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export which_declare 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+++ export -f which 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset i 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:++ unset -f pathmunge 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+ export PATH 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+ unset rc 2024-01-23T07:34:54.110 INFO:tasks.workunit.client.0.smithi116.stderr:+ tee ceph_test_neorados_write_operations.log 2024-01-23T07:34:54.111 INFO:tasks.workunit.client.0.smithi116.stderr:+ ceph_test_neorados_write_operations 2024-01-23T07:34:54.111 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ watch_notify: /' 2024-01-23T07:34:54.111 INFO:tasks.workunit.client.0.smithi116.stderr:+ sed 's/^/ write_operations: /' 2024-01-23T07:34:56.315 INFO:tasks.workunit.client.0.smithi116.stdout:mp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.644+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.644+0000 7fbbf37fe640 10 client.4471.objecter ms_handle_connect 0x7fbbe406ab50 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.644+0000 7fbc05435780 10 librados: wait_for_osdmap done waiting 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.644+0000 7fbc05435780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:53.644+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x56500d578970 con 0x56500d5fedb0 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:54.017+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbf40018f0 con 0x56500d5fedb0 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:54.017+0000 7fbbf37fe640 10 monclient: handle_get_version_reply finishing 1 version 24 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:54.017+0000 7fbbf3fff640 10 client.4471.objecter _get_latest_version latest 24, have it 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:54.017+0000 7fbc05435780 10 client.4471.objecter create_pool name=ceph_test_rados_api_asio 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:54.017+0000 7fbc05435780 10 client.4471.objecter pool_op_submit 1 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:54.017+0000 7fbc05435780 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:54.017+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) v4 -- 0x56500d589b70 con 0x56500d5fedb0 2024-01-23T07:34:56.316 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v26) v1 ==== 43+0+0 (secure 0 0 0) 0x7fbbf4014030 con 0x56500d5fedb0 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 pool_op_reply(tid 1 (0) Success v26) v1 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 10 client.4471.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v26) v1 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 10 client.4471.objecter have request 1 at 0x56500d692630 Op: create 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 20 client.4471.objecter waiting for client to reach epoch 26 before calling back 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 10 monclient: _renew_subs 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=25}) v3 -- 0x7fbbe4070890 con 0x56500d5fedb0 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.225+0000 7fbbf37fe640 10 client.4471.objecter done 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 8 ==== osd_map(25..26 src has 1..26) v4 ==== 14660+0+0 (secure 0 0 0) 0x7fbbf4056cc0 con 0x56500d5fedb0 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(25..26 src has 1..26) v4 2024-01-23T07:34:56.317 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [25,26] > 24 2024-01-23T07:34:58.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 25 2024-01-23T07:34:58.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 26 2024-01-23T07:34:58.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:34:58.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 10 librados: set snap read head -> 1 2024-01-23T07:34:58.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 10 librados: writefull oid=exist nspace= 2024-01-23T07:34:58.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d699b70 2024-01-23T07:34:58.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 26 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x56500d69a520 0x56500d69a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 2 osd.3 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 2 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 15 client.4471.objecter _send_op 2 to 21.1 on osd.3 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:2 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) v8 -- 0x56500d5c6fc0 con 0x56500d69a520 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.313+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.496+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.496+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:34:58.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.496+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:56.496+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:57.496+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:57.496+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:57.496+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:58.497+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:58.497+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:58.497+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:34:58.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:58.574+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:07.121 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:55.500 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.256 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:55.635 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.383 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:02:55.762 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.419 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:55.798 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.478 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:55.857 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.490 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:55.826 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.492 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:55.828 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.613 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:02:55.949 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:07.640 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:02:56.019 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:08.499 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:58.947+0000 7fbc02c4d640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x56500d69a520 0x56500d69a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T07:35:08.499 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:58.948+0000 7fbc02c4d640 10 monclient: get_auth_request con 0x56500d69a520 auth_method 0 2024-01-23T07:35:08.499 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:59.032+0000 7fbc02c4d640 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x56500d69a520 0x56500d69a900 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T07:35:08.499 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:59.032+0000 7fbbf37fe640 10 client.4471.objecter ms_handle_connect 0x56500d69a520 2024-01-23T07:35:08.499 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:59.497+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.499 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:59.497+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:34:59.497+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:00.497+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:00.497+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:00.497+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:01.498+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:01.498+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:01.498+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:02.498+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:02.498+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:02.498+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:03.498+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:03.498+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:03.498+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:03.575+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:04.498+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:04.498+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:04.498+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:05.498+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:05.498+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:05.498+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:06.498+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:06.498+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:06.498+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:06.498+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:07.498+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:07.498+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:07.498+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:08.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.576+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.576+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.576+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.576+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.576+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.576+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=27}) v3 -- 0x7fbbd4002f90 con 0x56500d5fedb0 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.576+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003320 con 0x56500d69a520 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 9 ==== osd_map(27..34 src has 1..34) v4 ==== 20863+0+0 (secure 0 0 0) 0x7fbbf405a710 con 0x56500d5fedb0 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(27..34 src has 1..34) v4 2024-01-23T07:35:08.614 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [27,34] > 26 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 27 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 27 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 28 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 28 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 29 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 29 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 30 2024-01-23T07:35:08.615 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:08.616 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 30 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:08.616 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:08.616 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 31 2024-01-23T07:35:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe64 handler_error: Running main() from gmock_main.cc 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [----------] Global test environment set-up. 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (16260 ms) 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [----------] 1 test from neocls_handler_error (16260 ms total) 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [----------] Global test environment tear-down 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [==========] 1 test from 1 test suite ran. (16260 ms total) 2024-01-23T07:35:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: handler_error: [ PASSED ] 1 test. 2024-01-23T07:35:13.577 INFO:tasks.workunit.client.0.smithi116.stdout:0 10 client.4471.objecter checking op 2 2024-01-23T07:35:13.577 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 31 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:13.577 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:13.577 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 32 2024-01-23T07:35:13.577 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:13.577 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 32 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:13.577 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:13.578 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 33 2024-01-23T07:35:13.578 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:13.578 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 33 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:13.578 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:13.578 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 34 2024-01-23T07:35:13.578 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:13.578 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 34 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:08.613+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:09.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:09.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:09.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:10.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:10.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:10.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:11.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:13.579 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:11.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:11.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:12.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:12.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:12.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.577+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:13.580 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.577+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.577+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.577+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.577+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.577+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=35}) v3 -- 0x7fbbd40034e0 con 0x56500d5fedb0 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.577+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd40036d0 con 0x56500d69a520 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 10 ==== osd_map(35..37 src has 1..37) v4 ==== 2656+0+0 (secure 0 0 0) 0x7fbbf40560d0 con 0x56500d5fedb0 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(35..37 src has 1..37) v4 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [35,37] > 34 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 35 2024-01-23T07:35:16.500 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 35 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 36 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 36 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 37 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 37 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:13.591+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:14.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:14.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:16.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:14.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:16.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:15.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:16.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:15.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:16.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:15.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:16.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:16.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:16.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:16.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:16.499+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:17.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:17.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:17.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.578+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:18.582 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.578+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.578+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.578+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.578+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.578+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7fbbd40034e0 con 0x56500d5fedb0 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.578+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003920 con 0x56500d69a520 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 11 ==== osd_map(38..41 src has 1..41) v4 ==== 2931+0+0 (secure 0 0 0) 0x7fbbf4056550 con 0x56500d5fedb0 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(38..41 src has 1..41) v4 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [38,41] > 37 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 38 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 38 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 39 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:18.583 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 39 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:18.584 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:18.584 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 40 2024-01-23T07:35:18.584 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:18.584 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 40 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:20.861 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objec pool: Running main() from gmock_main.cc 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [----------] Global test environment set-up. 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ OK ] NeoRadosPools.PoolList (6583 ms) 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (3938 ms) 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (4227 ms) 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (6803 ms) 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2598 ms) 2024-01-23T07:35:20.862 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-01-23T07:35:20.863 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2934 ms) 2024-01-23T07:35:20.863 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [----------] 6 tests from NeoRadosPools (27083 ms total) 2024-01-23T07:35:20.863 INFO:tasks.workunit.client.0.smithi116.stdout: pool: 2024-01-23T07:35:20.863 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [----------] Global test environment tear-down 2024-01-23T07:35:20.863 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [==========] 6 tests from 1 test suite ran. (27086 ms total) 2024-01-23T07:35:20.863 INFO:tasks.workunit.client.0.smithi116.stdout: pool: [ PASSED ] 6 tests. 2024-01-23T07:35:23.147 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-01-23T07:35:23.147 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [----------] Global test environment set-up. 2024-01-23T07:35:23.147 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [----------] 4 tests from LibRadosService 2024-01-23T07:35:23.147 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-01-23T07:35:23.147 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5432 ms) 2024-01-23T07:35:23.147 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-01-23T07:35:23.147 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ OK ] LibRadosService.RegisterLate (159 ms) 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: cluster: 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: id: 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: health: HEALTH_WARN 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 34 pool(s) do not have an application enabled 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: services: 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: osd: 8 osds: 8 up (since 96s), 8 in (since 2m) 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: laundry: 2 daemons active (1 hosts) 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: data: 2024-01-23T07:35:23.148 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: pools: 37 pools, 1129 pgs 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: objects: 2 objects, 449 KiB 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: pgs: 88.131% pgs unknown 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 11.072% pgs not active 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 995 unknown 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 125 creating+peering 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 9 active+clean 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: cluster: 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: id: 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: health: HEALTH_WARN 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 17 pool(s) do not have an application enabled 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.149 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: services: 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 2m) 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: osd: 8 osds: 8 up (since 99s), 8 in (since 2m) 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: data: 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: pools: 38 pools, 1113 pgs 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: objects: 2 objects, 449 KiB 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: usage: 214 MiB used, 720 GiB / 720 GiB avail 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: pgs: 68.643% pgs unknown 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 30.548% pgs not active 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 764 unknown 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 340 creating+peering 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 9 active+clean 2024-01-23T07:35:23.150 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ OK ] LibRadosService.StatusFormat (3955 ms) 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ RUN ] LibRadosService.Status 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ OK ] LibRadosService.Status (20071 ms) 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [----------] 4 tests from LibRadosService (29617 ms total) 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [----------] Global test environment tear-down 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [==========] 4 tests from 1 test suite ran. (29617 ms total) 2024-01-23T07:35:23.151 INFO:tasks.workunit.client.0.smithi116.stdout: api_service: [ PASSED ] 4 tests. 2024-01-23T07:35:23.595 INFO:tasks.workunit.client.0.smithi116.stdout:ter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:23.595 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 41 2024-01-23T07:35:23.595 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:23.595 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 41 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:23.595 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:23.595 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:18.581+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:19.499+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:19.499+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:19.499+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:20.500+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:20.500+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:20.500+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:21.500+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:21.500+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:21.500+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:22.500+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:22.500+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:23.596 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:22.500+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.500+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.500+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.500+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.579+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.579+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.579+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.579+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.579+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.579+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=42}) v3 -- 0x7fbbd40034e0 con 0x56500d5fedb0 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.579+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003ab0 con 0x56500d69a520 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 12 ==== osd_map(42..45 src has 1..45) v4 ==== 2183+0+0 (secure 0 0 0) 0x7fbbf4052cd0 con 0x56500d5fedb0 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(42..45 src has 1..45) v4 2024-01-23T07:35:23.597 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [42,45] > 41 2024-01-23T07:35:26.292 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07 api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-01-23T07:35:26.292 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [----------] Global test environment set-up. 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5453 ms) 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (228 ms) 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (21235 ms) 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 0 of 20 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 12, 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:22.412120+0000", 2024-01-23T07:35:26.293 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "laundry": { 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 12, 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:21.190464+0000", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4777, 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/3777800297", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:26.294 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "pid41063": { 2024-01-23T07:35:26.295 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 11, 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:03.155709+0000", 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4699, 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/3356896705", 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:26.296 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:26.525 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:26.418+0000 12c56640 -1 osd.3 46 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4554.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:27.027 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:27.019+0000 12c56640 -1 osd.4 44 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4524.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:27.387 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:27.215+0000 12c56640 -1 osd.1 44 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:27.628 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:03:16.007 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.638 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:03:16.017 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.692 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:16.028 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.693 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:03:16.073 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.697 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:16.034 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.698 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:03:16.078 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.856 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:03:16.236 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.892 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:27.723+0000 12c56640 -1 osd.3 46 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4554.0:2 33.1 33:847a3d55:::obj:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:27.902 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:03:16.281 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:27.904 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:16.240 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:28.161 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:28.108+0000 12c56640 -1 osd.4 44 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4524.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:28.414 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:28.410+0000 12c56640 -1 osd.1 46 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: :35:23.595+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 42 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 42 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 43 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 43 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 44 2024-01-23T07:35:28.501 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 44 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 45 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 45 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:23.595+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:24.500+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:24.500+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:24.500+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:25.500+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:28.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:25.500+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:25.500+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:26.500+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:26.500+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:26.500+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:26.500+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:27.501+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:27.501+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:27.501+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.501+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:28.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.501+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:29.167 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:29.123+0000 12c56640 -1 osd.4 46 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4524.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:29.337 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:29.304+0000 12c56640 -1 osd.3 47 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:29.566 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.501+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.580+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.580+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.580+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.580+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.580+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.580+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=46}) v3 -- 0x7fbbd40034e0 con 0x56500d5fedb0 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.580+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003ca0 con 0x56500d69a520 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.582+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 13 ==== osd_map(46..48 src has 1..48) v4 ==== 1551+0+0 (secure 0 0 0) 0x7fbbf400d2c0 con 0x56500d5fedb0 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(46..48 src has 1..48) v4 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [46,48] > 45 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 46 2024-01-23T07:35:29.567 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 46 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 47 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 47 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 48 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 48 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:28.583+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:29.568 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.501+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:29.569 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.501+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:29.569 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.501+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:30.083 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:29.930+0000 12c56640 -1 osd.1 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:30.693 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:30.514+0000 12c56640 -1 osd.3 48 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:30.707 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:30.698+0000 12c56640 -1 osd.4 46 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4524.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:31.081 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:30.996+0000 12c56640 -1 osd.1 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:31.919 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:31.869+0000 12c56640 -1 osd.4 47 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4524.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:32.007 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:31.966+0000 12c56640 -1 osd.3 49 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:32.033 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:32.023+0000 12c56640 -1 osd.1 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:32.408 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:32.393+0000 ec4e640 -1 osd.5 50 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:33.024 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:32.917+0000 12c56640 -1 osd.4 48 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4524.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:33.140 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:33.137+0000 12c56640 -1 osd.1 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:33.541 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:33.448+0000 12c56640 -1 osd.3 50 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:33.893 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.567+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 1 ==== osd_map(27..42 src has 1..46) v4 ==== 27365+0+0 (crc 0 0 0) 0x7fbbfc052580 con 0x56500d69a520 2024-01-23T07:35:33.893 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.567+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(27..42 src has 1..46) v4 2024-01-23T07:35:33.893 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.567+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map ignoring epochs [27,42] <= 48 2024-01-23T07:35:33.893 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.567+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:33.893 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:29.567+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:33.893 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:30.501+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:30.501+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:30.501+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:31.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:31.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:31.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:32.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:32.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:32.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.581+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.581+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.581+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:33.894 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.581+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.581+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.581+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=49}) v3 -- 0x7fbbd40034e0 con 0x56500d5fedb0 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.581+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003e30 con 0x56500d69a520 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 14 ==== osd_map(49..53 src has 1..53) v4 ==== 3557+0+0 (secure 0 0 0) 0x7fbbf400d480 con 0x56500d5fedb0 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(49..53 src has 1..53) v4 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [49,53] > 48 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 49 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 49 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:33.895 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:33.934 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:33.925+0000 ec4e640 -1 osd.5 52 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:34.181 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:34.178+0000 12c56640 -1 osd.1 50 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:34.716 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:34.628+0000 12c56640 -1 osd.4 49 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4524.0:2 14.1a 14:5c6776db:::0.obj:head [write 0~0] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:35.214 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:35.140+0000 ec4e640 -1 osd.5 53 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:35.221 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:35.218+0000 12c56640 -1 osd.1 52 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:36.400 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:36.376+0000 12c56640 -1 osd.1 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:36.736 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 3 client.4471.obje api_service_pp: "distro": "centos", 2024-01-23T07:35:36.736 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:36.736 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:36.736 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:36.736 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:36.736 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:36.736 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 1 of 20 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:35:36.737 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 14, 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:26.414258+0000", 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "laundry": { 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 14, 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:26.381079+0000", 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4789, 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/304907877", 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:36.738 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:35:36.739 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 2 of 20 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 16, 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:32.418190+0000", 2024-01-23T07:35:36.740 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:35:37.558 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:37.464+0000 12c56640 -1 osd.1 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:38.067 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:38.046+0000 12c56640 -1 osd.3 54 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:38.112 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:38.088+0000 12c56640 -1 osd.4 52 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:38.502 INFO:tasks.workunit.client.0.smithi116.stdout: cter handle_osd_map decoding incremental epoch 50 2024-01-23T07:35:38.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.893+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:38.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 50 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:38.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:38.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 51 2024-01-23T07:35:38.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 51 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 52 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 52 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 53 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 53 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:38.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:33.894+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:34.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:34.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:34.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:35.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:35.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:35.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:36.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:36.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:36.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:36.503+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:37.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:38.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:37.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:38.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:37.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:38.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:38.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:38.552 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:38.541+0000 12c56640 -1 osd.1 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:39.207 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:39.198+0000 12c56640 -1 osd.4 53 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:39.351 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:39.269+0000 12c56640 -1 osd.3 55 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:39.689 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:39.578+0000 12c56640 -1 osd.1 55 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:40.440 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:40.430+0000 ec4e640 -1 osd.5 57 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:40.444 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:40.387+0000 12c56640 -1 osd.3 56 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:40.502 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.581+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.581+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.581+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.581+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.581+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.581+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=54}) v3 -- 0x7fbbd40034b0 con 0x56500d5fedb0 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.581+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003e30 con 0x56500d69a520 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 15 ==== osd_map(54..56 src has 1..56) v4 ==== 1563+0+0 (secure 0 0 0) 0x7fbbf400d480 con 0x56500d5fedb0 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(54..56 src has 1..56) v4 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [54,56] > 53 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 54 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:40.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 54 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 55 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 55 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 56 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 56 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:38.584+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:39.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:40.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:39.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:40.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:39.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:40.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:40.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:40.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:40.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:40.702 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:40.691+0000 12c56640 -1 osd.1 56 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:40.826 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:40.818+0000 12c56640 -1 osd.4 54 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:41.765 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:41.751+0000 ec4e640 -1 osd.2 56 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:41.788 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:41.711+0000 12c56640 -1 osd.3 57 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:41.844 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:41.788+0000 12c56640 -1 osd.1 57 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:41.931 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:40.502+0000 7fbbf27fc6 api_service_pp: "laundry": { 2024-01-23T07:35:41.931 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:35:41.932 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:35:41.932 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:35:41.932 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 16, 2024-01-23T07:35:41.932 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:31.644895+0000", 2024-01-23T07:35:41.932 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4804, 2024-01-23T07:35:41.932 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/2871000067", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:41.933 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 3 of 20 2024-01-23T07:35:41.934 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 18, 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:38.422185+0000", 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "laundry": { 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 18, 2024-01-23T07:35:41.935 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:36.818912+0000", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4810, 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/3456722356", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:41.936 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:42.408 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:42.239+0000 12c56640 -1 osd.4 56 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:42.799 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:42.793+0000 12c56640 -1 osd.3 58 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:42.825 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:42.727+0000 ec4e640 -1 osd.2 57 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:43.200 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:43.040+0000 12c56640 -1 osd.1 58 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:43.265 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:43.256+0000 12c56640 -1 osd.4 57 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 40 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:41.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:41.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:41.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:42.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:42.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:42.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.582+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.582+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:43.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.582+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.582+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.582+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.582+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=57}) v3 -- 0x7fbbd40034b0 con 0x56500d5fedb0 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.582+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003e30 con 0x56500d69a520 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 16 ==== osd_map(57..60 src has 1..60) v4 ==== 2932+0+0 (secure 0 0 0) 0x7fbbf400d480 con 0x56500d5fedb0 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(57..60 src has 1..60) v4 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [57,60] > 56 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 57 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 57 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 58 2024-01-23T07:35:43.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:43.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 58 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:43.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:43.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 59 2024-01-23T07:35:43.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:43.788 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:43.774+0000 ec4e640 -1 osd.2 58 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:44.203 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:44.129+0000 12c56640 -1 osd.3 59 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:44.418 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:44.295+0000 12c56640 -1 osd.4 57 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:44.468 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:44.396+0000 12c56640 -1 osd.1 60 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:44.936 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:44.933+0000 ec4e640 -1 osd.2 59 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:45.602 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:45.519+0000 12c56640 -1 osd.1 60 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:45.661 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:45.623+0000 12c56640 -1 osd.3 61 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:45.903 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:45.759+0000 12c56640 -1 osd.4 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:46.548 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:46.413+0000 ec4e640 -1 osd.2 60 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:46.649 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:46.626+0000 12c56640 -1 osd.1 61 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:46.676 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:46.670+0000 12c56640 -1 osd.3 61 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:46.853 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:46.806+0000 12c56640 -1 osd.4 60 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:47.762 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:47.751+0000 12c56640 -1 osd.1 62 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:47.854 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:47.788+0000 12c56640 -1 osd.3 62 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:48.039 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:48.034+0000 ec4e640 -1 osd.2 61 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:48.104 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:48.096+0000 12c56640 -1 osd.4 61 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:48.432 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:48.424+0000 ec4e640 -1 osd.5 63 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:48.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 59 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:48.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:48.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 60 2024-01-23T07:35:48.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:48.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 60 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:48.586 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:43.585+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:44.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:44.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:44.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:45.502+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:45.502+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:45.502+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:46.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:46.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:46.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:46.503+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:47.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:48.587 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:47.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:47.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.583+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.583+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.583+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.583+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.583+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.583+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=61}) v3 -- 0x7fbbd40034b0 con 0x56500d5fedb0 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.583+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003fa0 con 0x56500d69a520 2024-01-23T07:35:48.588 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 17 ==== osd_map(61..64 src has 1..64) v4 ==== 2854+0+0 (secure 0 0 0) 0x7fbbf400d480 con 0x56500d5fedb0 2024-01-23T07:35:48.620 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:03:36.999 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:48.705 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:03:37.084 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:48.771 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:37.107 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:48.781 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:37.117 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:48.781 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:03:37.161 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:48.863 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:48.847+0000 12c56640 -1 osd.1 63 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:48.902 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:03:37.282 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:48.908 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:48.814+0000 12c56640 -1 osd.3 63 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:48.966 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:03:37.302 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:49.029 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:03:37.409 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:49.118 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:03:37.497 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:35:49.369 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:49.365+0000 ec4e640 -1 osd.2 62 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:49.400 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:49.378+0000 12c56640 -1 osd.4 63 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:49.528 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:49.516+0000 ec4e640 -1 osd.5 64 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:49.911 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:49.902+0000 12c56640 -1 osd.1 63 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:50.215 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:50.105+0000 12c56640 -1 osd.3 64 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:50.464 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:50.409+0000 12c56640 -1 osd.4 64 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:50.515 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:50.509+0000 ec4e640 -1 osd.5 64 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:50.678 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:50.602+0000 ec4e640 -1 osd.2 63 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:51.262 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:51.171+0000 12c56640 -1 osd.3 65 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:51.356 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:35:51.320+0000 12c56640 -1 osd.1 64 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4545.0:2 20.1a 20:5c6776db:::0.obj:head [write 0~197 in=197b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:51.602 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:51.598+0000 ec4e640 -1 osd.5 65 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:51.749 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:51.732+0000 12c56640 -1 osd.4 64 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:51.881 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:51.839+0000 ec4e640 -1 osd.2 64 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:52.240 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:52.227+0000 12c56640 -1 osd.3 65 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 10 client.44 api_misc: [==========] Running 12 tests from 4 test suites. 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] Global test environment set-up. 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-01-23T07:35:52.332 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: 2024-01-23T07:34:53.870+0000 7f6d5aecc780 -1 failed for service _ceph-mon._tcp 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: 2024-01-23T07:34:53.870+0000 7f6d5aecc780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (480 ms) 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2006 ms) 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2486 ms total) 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-01-23T07:35:52.333 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac4dd390 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac6f7fb0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac4e1430 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac63d000 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877100 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877b00 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8784c0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac878ea0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8768d0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8772b0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8769e0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac86d800 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac876af0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac876c00 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8785d0 2024-01-23T07:35:52.334 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8786e0 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac878940 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac879ca0 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877520 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac86d270 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac86d380 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac86d490 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac86d630 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87b560 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac879a80 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac878fb0 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac879560 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac879670 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8797f0 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87a7d0 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87ac40 2024-01-23T07:35:52.335 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87ad50 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87b340 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad0ff720 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad0ff830 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad0ff980 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac879db0 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87a400 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877630 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87a510 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87a620 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8790c0 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad0ffa90 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac8791d0 2024-01-23T07:35:52.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac879320 2024-01-23T07:35:52.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877c10 2024-01-23T07:35:52.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877d20 2024-01-23T07:35:52.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877e30 2024-01-23T07:35:52.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac877f80 2024-01-23T07:35:52.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad0ffc10 2024-01-23T07:35:52.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87ae60 2024-01-23T07:35:52.621 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:52.616+0000 ec4e640 -1 osd.5 65 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: starte "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:52.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 4 of 20 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 20, 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:42.425108+0000", 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "laundry": { 2024-01-23T07:35:52.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 20, 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:42.055658+0000", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4828, 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/2388805330", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:35:52.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.673 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 5 of 20 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 22, 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:48.428873+0000", 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "laundry": { 2024-01-23T07:35:52.674 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:35:52.675 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:35:52.675 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:35:52.675 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 22, 2024-01-23T07:35:52.675 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:47.688412+0000", 2024-01-23T07:35:52.802 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:52.793+0000 12c56640 -1 osd.4 65 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:53.144 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:53.005+0000 ec4e640 -1 osd.2 65 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:53.266 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:35:53.217+0000 ec4e640 -1 osd.6 65 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:53.503 INFO:tasks.workunit.client.0.smithi116.stdout: api_s71.objecter ms_dispatch 0x56500d573560 osd_map(61..64 src has 1..64) v4 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [61,64] > 60 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 61 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 61 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 62 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 62 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 63 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 63 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:53.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 64 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 64 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:48.586+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:49.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:49.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:49.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:50.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:50.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:50.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:51.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:51.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:53.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:51.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:53.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:52.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:53.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:52.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:53.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:52.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:53.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:53.518 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:53.415+0000 12c56640 -1 osd.3 66 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:53.778 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:53.766+0000 ec4e640 -1 osd.5 66 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:54.044 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:54.016+0000 ec4e640 -1 osd.2 65 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:54.175 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:54.166+0000 12c56640 -1 osd.4 66 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:54.251 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:35:54.244+0000 ec4e640 -1 osd.6 65 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:54.496 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:54.465+0000 12c56640 -1 osd.3 67 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:54.755 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:54.750+0000 ec4e640 -1 osd.5 66 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:55.147 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:55.139+0000 12c56640 -1 osd.4 66 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:55.278 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:55.261+0000 ec4e640 -1 osd.2 66 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:55.459 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:35:55.353+0000 ec4e640 -1 osd.6 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.584+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.584+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.584+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.584+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.584+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.584+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=65}) v3 -- 0x7fbbd40034b0 con 0x56500d5fedb0 2024-01-23T07:35:55.504 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.584+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003ee0 con 0x56500d69a520 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 18 ==== osd_map(65..67 src has 1..67) v4 ==== 2612+0+0 (secure 0 0 0) 0x7fbbf400d480 con 0x56500d5fedb0 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(65..67 src has 1..67) v4 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [65,67] > 64 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 65 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 65 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 66 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 66 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 67 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:55.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 67 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:55.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:55.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:35:55.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:53.587+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:35:55.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:54.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:55.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:54.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:55.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:54.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:55.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:55.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:55.574 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:55.546+0000 12c56640 -1 osd.3 67 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:55.591 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: Running main() from gmock_main.cc 2024-01-23T07:35:55.591 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-01-23T07:35:55.591 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [----------] Global test environment set-up. 2024-01-23T07:35:55.591 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-01-23T07:35:55.591 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-01-23T07:35:55.591 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: handle_notify cookie 93897025648528 notify_id 214748364800 notifier_gid 4530 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (45658 ms) 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: Trying... 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: handle_notify cookie 93897038709600 notify_id 274877906945 notifier_gid 4816 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: Waiting for 3.000000000s 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: Timed out. 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: Flushing... 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: Flushed... 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (16131 ms) 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (61790 ms total) 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [----------] Global test environment tear-down 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (61790 ms total) 2024-01-23T07:35:55.592 INFO:tasks.workunit.client.0.smithi116.stdout: watch_notify: [ PASSED ] 2 tests. 2024-01-23T07:35:55.850 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:55.842+0000 ec4e640 -1 osd.5 67 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:56.369 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:35:56.302+0000 12c56640 -1 osd.4 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.14441.0:3 37.14 37.2b3e2654 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e32) 2024-01-23T07:35:56.421 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:35:56.416+0000 ec4e640 -1 osd.6 67 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:56.480 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:56.412+0000 ec4e640 -1 osd.2 67 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:56.924 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:56.918+0000 ec4e640 -1 osd.5 68 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:57.007 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:56.840+0000 12c56640 -1 osd.3 68 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:57.728 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:57.719+0000 ec4e640 -1 osd.2 67 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout:ervice_pp: "gid": 14636, 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/3035123400", 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:35:57.837 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:57.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 6 of 20 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 24, 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:54.434060+0000", 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "laundry": { 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 24, 2024-01-23T07:35:57.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:52.748266+0000", 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4861, 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/2947867326", 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:35:57.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:35:57.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:35:57.901 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:35:57.894+0000 ec4e640 -1 osd.6 69 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:57.976 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:35:57.958+0000 ec4e640 -1 osd.5 69 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4561.0:2 26.1a 26:5c6776db:::0.obj:head [write 0~245 in=245b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:58.407 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:58.366+0000 12c56640 -1 osd.3 69 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:35:58.728 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "o api_asio: 2024-01-23T07:35:55.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:58.728 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:55.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:58.728 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:56.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:56.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:56.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:56.503+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:57.503+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:57.503+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:57.503+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.585+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.585+0000 7fbc046b0640 2 client.4471.objecter tid 2 on osd.3 is laggy 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.585+0000 7fbc046b0640 10 client.4471.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.585+0000 7fbc046b0640 10 monclient: _renew_subs 2024-01-23T07:35:58.729 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.585+0000 7fbc046b0640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.585+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=68}) v3 -- 0x7fbbd40034b0 con 0x56500d5fedb0 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.585+0000 7fbc046b0640 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- ping magic: 0 v1 -- 0x7fbbd4003ee0 con 0x56500d69a520 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== mon.1 v2:172.21.15.173:3300/0 19 ==== osd_map(68..70 src has 1..70) v4 ==== 848+0+0 (secure 0 0 0) 0x7fbbf400d480 con 0x56500d5fedb0 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(68..70 src has 1..70) v4 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [68,70] > 67 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 68 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 68 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 69 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 69 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:35:58.730 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 3 client.4471.object api_pool: Running main() from gmock_main.cc 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [----------] Global test environment set-up. 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolList (9668 ms) 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3651 ms) 2024-01-23T07:35:58.790 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (6194 ms) 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3734 ms) 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (6760 ms) 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (6908 ms) 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6445 ms) 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (6314 ms) 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (15672 ms) 2024-01-23T07:35:58.791 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [----------] 9 tests from LibRadosPools (65346 ms total) 2024-01-23T07:35:58.792 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: 2024-01-23T07:35:58.792 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [----------] Global test environment tear-down 2024-01-23T07:35:58.792 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (65346 ms total) 2024-01-23T07:35:58.792 INFO:tasks.workunit.client.0.smithi116.stdout: api_pool: [ PASSED ] 9 tests. 2024-01-23T07:35:58.965 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:35:58.956+0000 ec4e640 -1 osd.6 69 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:59.132 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:35:59.077+0000 ec4e640 -1 osd.2 69 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:35:59.673 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:35:59.588+0000 12c56640 -1 osd.3 70 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:36:00.007 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:35:59.998+0000 ec4e640 -1 osd.6 69 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:00.225 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:00.192+0000 ec4e640 -1 osd.2 70 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:00.707 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:36:00.700+0000 12c56640 -1 osd.3 71 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:36:01.528 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:01.440+0000 ec4e640 -1 osd.2 70 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:01.532 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:36:01.513+0000 ec4e640 -1 osd.6 71 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:01.784 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:36:01.753+0000 12c56640 -1 osd.3 71 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4579.0:2 31.0 31:0384ab8e:::oid:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) 2024-01-23T07:36:02.502 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:02.492+0000 ec4e640 -1 osd.2 70 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:02.749 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:36:02.738+0000 ec4e640 -1 osd.6 72 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:03.466 INFO:tasks.workunit.client.0.smithi116.stdout:er handle_osd_map decoding incremental epoch 70 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 10 client.4471.objecter checking op 2 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 70 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:58.728+0000 7fbbf37fe640 20 client.4471.objecter 2 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:59.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:59.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:35:59.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:00.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:00.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:00.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:01.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:01.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:03.467 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:01.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:02.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:02.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:02.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 2 ==== osd_op_reply(2 exist [writefull 0~5] v42'1 uv1 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(2 exist [writefull 0~5] v42'1 uv1 ondisk = 0) v8 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 2 ondisk uv 1 in 21.1 attempt 0 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 2 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 2 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:03.468 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 2 2024-01-23T07:36:03.469 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:03.469 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 10 librados: Objecter returned from writefull r=0 2024-01-23T07:36:03.469 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d699b70 2024-01-23T07:36:03.469 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 70 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:03.469 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:03.597 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:03.588+0000 ec4e640 -1 osd.2 71 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:04.254 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:36:04.171+0000 ec4e640 -1 osd.6 74 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4498.0:2 12.6 12:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:04.953 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:04.810+0000 ec4e640 -1 osd.2 72 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 3 osd.3 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 3 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 15 client.4471.objecter _send_op 3 to 21.1 on osd.3 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:3 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70) v8 -- 0x56500d688f20 con 0x56500d69a520 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:05.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 70 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 10 client.4471.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 4 osd.3 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 4 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 15 client.4471.objecter _send_op 4 to 21.1 on osd.3 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:4 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e70) v8 -- 0x56500d689720 con 0x56500d69a520 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.466+0000 7fbc05435780 5 client.4471.objecter 2 in flight 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:05.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:05.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:03.586+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:05.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:04.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:05.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:04.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:05.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:04.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:05.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:05.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:06.437 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:06.342+0000 ec4e640 -1 osd.2 73 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4552.0:2 23.15 23.40e8aab5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e28) 2024-01-23T07:36:07.427 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:07.382+0000 ec4e640 -1 osd.2 73 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4615.0:2 41.6 41.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-01-23T07:36:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:05.504+0000 7fbbf27fc640 10 monclient: _check_auth_tis": "Linux", 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 7 of 20 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: failed to deregister: 2024-01-23T07:36:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: { 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "epoch": 26, 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "modified": "2024-01-23T07:35:58.437459+0000", 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "services": { 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "laundry": { 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "daemons": { 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "summary": "", 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "close-test-pid41102": { 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_epoch": 26, 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "start_stamp": "2024-01-23T07:35:57.918104+0000", 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "gid": 4698, 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "addr": "172.21.15.116:0/2030703500", 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "metadata": { 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "arch": "x86_64", 2024-01-23T07:36:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_release": "squid", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version": "ceph version 19.0.0-779-g1d156303 (1d1563036928048a487b8d17bdf66baca01c75bf) squid (dev)", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "ceph_version_short": "19.0.0-779-g1d156303", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro": "centos", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_description": "CentOS Stream 9", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "distro_version": "9", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "foo": "bar", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "hostname": "smithi116", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Thu Jan 18 20:27:59 UTC 2024", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "kernel_version": "5.14.0-410.el9.x86_64", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_swap_kb": "0", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "mem_total_kb": "32488548", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "os": "Linux", 2024-01-23T07:36:08.411 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "this": "that" 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: }, 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: "task_status": {} 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: } 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: attempt 8 of 20 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (47922 ms) 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (74838 ms total) 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [----------] Global test environment tear-down 2024-01-23T07:36:08.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (74838 ms total) 2024-01-23T07:36:08.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-01-23T07:36:08.756 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:08.660+0000 ec4e640 -1 osd.2 74 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4615.0:2 41.6 41.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-01-23T07:36:09.676 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:09.637+0000 ec4e640 -1 osd.2 74 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4615.0:2 41.6 41:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-01-23T07:36:10.928 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:10.921+0000 ec4e640 -1 osd.2 75 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4615.0:2 41.6 41:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-01-23T07:36:11.910 INFO:tasks.workunit.client.0.smithi116.stdout:ckets 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:05.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:06.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:06.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:06.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:06.504+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:07.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:07.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:07.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:08.504+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:08.504+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:08.504+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:11.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:08.587+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:09.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:09.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:09.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:10.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:10.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:10.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 3 ==== osd_map(71..75 src has 1..76) v4 ==== 4588+0+0 (crc 0 0 0) 0x7fbbfc063040 con 0x56500d69a520 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 4 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(71..75 src has 1..76) v4 2024-01-23T07:36:11.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [71,75] > 70 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 71 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 3 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 71 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 4 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 71 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 72 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 3 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 72 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:11.913 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 4 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 72 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 73 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 3 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 73 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 4 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 73 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 74 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 3 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 74 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.914 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 4 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 74 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 75 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 3 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 75 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 10 client.4471.objecter checking op 4 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 75 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter 3 21.d3a59201 osd.3 exist [read 0~256] 2024-01-23T07:36:11.915 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbbf37fe640 20 client.4471.objecter 4 21.a7bbaa1 osd.3 noexist [read 0~256] 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 3 ondisk uv 1 in 21.1 attempt 0 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 5 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 3 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 3 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 3 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 5 client.4471.objecter 1 in flight 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 5 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 4 ondisk uv 0 in 21.1 attempt 0 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 10 client.4471.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:11.916 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 4 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 4 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 4 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (8444 ms) 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 75 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 5 osd.3 2024-01-23T07:36:11.917 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:13.331 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:36:13.328+0000 ec4e640 -1 osd.2 77 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4615.0:2 41.6 41:602f83fe:::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) 2024-01-23T07:36:14.545 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:04:02.924 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.551 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:04:02.929 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.621 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:04:02.957 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.623 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:04:02.959 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.630 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:04:03.010 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.638 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:04:03.017 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.798 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:04:03.134 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.847 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:04:03.226 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:14.890 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:04:03.269 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:16.505 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 5 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 15 client.4471.objecter _send_op 5 to 21.1 on osd.3 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:5 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) v8 -- 0x56500d689ab0 con 0x56500d69a520 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d699b70 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 75 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 10 client.4471.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 6 osd.3 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:16.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 6 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 15 client.4471.objecter _send_op 6 to 21.1 on osd.3 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:6 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) v8 -- 0x56500d749b00 con 0x56500d69a520 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:11.910+0000 7fbc05435780 5 client.4471.objecter 2 in flight 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:12.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:12.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:12.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:13.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:13.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:13.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:13.588+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:14.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:14.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:16.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:14.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:16.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:15.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:16.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:15.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:16.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:15.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:16.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.505+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 7 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 5 ondisk uv 1 in 21.1 attempt 0 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 5 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 5 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 5 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:16.973 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 5 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 5 client.4471.objecter 1 in flight 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 8 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 6 ondisk uv 0 in 21.1 attempt 0 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 10 client.4471.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 6 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 6 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 6 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:16.974 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (5062 ms) 2024-01-23T07:36:16.975 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-01-23T07:36:16.975 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:16.975 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 75 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.975 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.975 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:16.975 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [read 0~256] tid 7 osd.3 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 7 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 15 client.4471.objecter _send_op 7 to 21.1 on osd.3 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:7 21.1 21:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) v8 -- 0x56500d699b50 con 0x56500d69a520 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d78a4f0 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 75 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:16.976 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 10 client.4471.objecter _op_submit oid noexist '@21' '@21' [read 0~256] tid 8 osd.3 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 8 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 15 client.4471.objecter _send_op 8 to 21.1 on osd.3 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:8 21.1 21:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e75) v8 -- 0x56500d78a990 con 0x56500d69a520 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbc05435780 5 client.4471.objecter 2 in flight 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 6 ==== osd_map(76..84 src has 1..84) v4 ==== 5565+0+0 (crc 0 0 0) 0x7fbbfc0528e0 con 0x56500d69a520 2024-01-23T07:36:16.977 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(76..84 src has 1..84) v4 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [76,84] > 75 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 76 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 76 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 76 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 77 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 77 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.978 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 77 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 78 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 78 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 78 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 79 2024-01-23T07:36:16.979 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 79 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 79 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 80 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 80 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.972+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.980 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 80 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 81 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 81 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 81 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 82 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 82 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.981 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 82 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 83 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 83 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 83 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 84 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 7 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 84 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 10 client.4471.objecter checking op 8 2024-01-23T07:36:16.982 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 84 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4d 0x55e8ac879430 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87af70 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87b080 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87b1d0 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad100260 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1b5480 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1b5590 2024-01-23T07:36:18.336 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1b56a0 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1b57b0 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87bb10 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87bc20 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87b450 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87bd70 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87bec0 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad101ad0 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad102120 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1b46c0 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ac87b670 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad0ffda0 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad102770 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1030c0 2024-01-23T07:36:18.337 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad100370 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad100ce0 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad101650 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1017a0 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1018b0 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 0x55e8ad1019c0 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: started 78 aios 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac4dd390 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac6f7fb0 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac4e1430 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac63d000 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877100 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877b00 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8784c0 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac878ea0 2024-01-23T07:36:18.338 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8768d0 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8772b0 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8769e0 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac86d800 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac876af0 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac876c00 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8785d0 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8786e0 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac878940 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac879ca0 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877520 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac86d270 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac86d380 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac86d490 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac86d630 2024-01-23T07:36:18.339 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87b560 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac879a80 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac878fb0 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac879560 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac879670 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8797f0 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87a7d0 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87ac40 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87ad50 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87b340 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad0ff720 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad0ff830 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad0ff980 2024-01-23T07:36:18.340 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac879db0 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87a400 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877630 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87a510 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87a620 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8790c0 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad0ffa90 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac8791d0 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac879320 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877c10 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877d20 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877e30 2024-01-23T07:36:18.341 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac877f80 2024-01-23T07:36:18.342 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad0ffc10 2024-01-23T07:36:18.342 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87ae60 2024-01-23T07:36:18.342 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac879430 2024-01-23T07:36:18.342 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87af70 2024-01-23T07:36:18.342 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87b080 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter 7 21.d3a59201 osd.3 exist [read 0~256] 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:16.973+0000 7fbbf37fe640 20 client.4471.objecter 8 21.a7bbaa1 osd.3 noexist [read 0~256] 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:17.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:17.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:17.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:18.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:18.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:20.058 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:18.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:18.589+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:19.505+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:19.505+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:19.505+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 10 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) v8 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 7 ondisk uv 1 in 21.1 attempt 0 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 5 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 7 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 7 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 7 2024-01-23T07:36:20.059 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 5 client.4471.objecter 1 in flight 2024-01-23T07:36:20.060 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 11 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:20.060 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-01-23T07:36:20.060 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:20.060 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 8 ondisk uv 0 in 21.1 attempt 0 2024-01-23T07:36:20.060 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 10 client.4471.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-01-23T07:36:20.060 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:20.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 8 2024-01-23T07:36:20.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 8 2024-01-23T07:36:20.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:20.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 8 2024-01-23T07:36:20.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:20.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 9 ==== osd_map(85..86 src has 1..87) v4 ==== 556+0+0 (crc 0 0 0) 0x7fbbfc0528e0 con 0x56500d69a520 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(85..86 src has 1..87) v4 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [85,86] > 84 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 85 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 86 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (3086 ms) 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 20 librados: queue_aio_write 0x56500d578690 completion 0x56500d603380 write_seq 1 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 86 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:20.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 9 osd.3 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 9 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 15 client.4471.objecter _send_op 9 to 21.1 on osd.3 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.057+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:9 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e86) v8 -- 0x56500d5d18d0 con 0x56500d69a520 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.058+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.058+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.058+0000 7fbc05435780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:20.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:20.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:21.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:21.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:21.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:22.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:22.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:22.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:24.867 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:23.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:23.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:23.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:23.590+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 13 ==== osd_op_reply(9 exist [write 0~5] v89'2 uv2 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 12 ==== osd_map(87..89 src has 1..89) v4 ==== 820+0+0 (crc 0 0 0) 0x7fbbfc063020 con 0x56500d69a520 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(9 exist [write 0~5] v89'2 uv2 ondisk = 0) v8 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(87..89 src has 1..89) v4 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [87,89] > 86 2024-01-23T07:36:24.868 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 87 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 10 client.4471.objecter checking op 9 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 87 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 88 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 10 client.4471.objecter checking op 9 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 88 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 89 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 10 client.4471.objecter checking op 9 2024-01-23T07:36:24.869 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 89 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:26.506 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbbf37fe640 20 client.4471.objecter 9 21.d3a59201 osd.3 exist [write 0~5 in=5b] 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 9 ondisk uv 2 in 21.1 attempt 0 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 9 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 9 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 9 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc02c4d640 20 librados: complete_aio_write 0x56500d603380 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (4809 ms) 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-01-23T07:36:26.507 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 20 librados: queue_aio_write 0x56500d578690 completion 0x56500d51fd50 write_seq 2 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 89 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 10 osd.3 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 10 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 15 client.4471.objecter _send_op 10 to 21.1 on osd.3 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:10 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e89) v8 -- 0x56500d5d18d0 con 0x56500d69a520 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.866+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:26.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:24.867+0000 7fbc05435780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-01-23T07:36:26.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:25.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:26.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:25.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:26.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:25.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:26.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:26.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:30.216 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:30.196+0000 12c56640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:00.055483+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:30.558 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:30.554+0000 12c56640 -1 osd.1 94 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:31.737 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:31.647+0000 12c56640 -1 osd.1 95 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:32.686 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:32.485+0000 12c56640 -1 osd.4 98 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:00.055483+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:34.045 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:34.040+0000 12c56640 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:00.055483+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:35.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:26.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:26.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:26.506+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:27.506+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:27.506+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:27.506+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:28.507+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:28.507+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:28.507+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:28.591+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:29.507+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:29.507+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:29.507+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:30.507+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:30.507+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:30.507+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:31.507+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:31.507+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:31.507+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:32.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:32.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:32.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:33.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:33.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:33.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:33.592+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:34.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:34.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:35.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:34.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 14 ==== osd_map(90..92 src has 1..94) v4 ==== 2282+0+0 (crc 0 0 0) 0x7fbbfc0528e0 con 0x56500d69a520 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 15 ==== osd_op_reply(10 exist [write 0~5] v92'3 uv3 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(90..92 src has 1..94) v4 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(10 exist [write 0~5] v92'3 uv3 ondisk = 0) v8 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [90,92] > 89 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 90 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 10 client.4471.objecter checking op 10 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 90 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 91 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 10 client.4471.objecter checking op 10 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 91 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:35.417 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 92 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 10 client.4471.objecter checking op 10 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 92 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbbf37fe640 20 client.4471.objecter 10 21.d3a59201 osd.3 exist [write 0~5 in=5b] 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 10 ondisk uv 3 in 21.1 attempt 0 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 10 2024-01-23T07:36:35.418 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 10 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 10 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc02c4d640 20 librados: complete_aio_write 0x56500d51fd50 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (10547 ms) 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 librados: queue_aio_write 0x56500d578690 completion 0x56500d6921b0 write_seq 3 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 92 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:35.419 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:35.454 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:35.443+0000 12c56640 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:00.055483+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:36.200 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:36.165+0000 12c56640 -1 osd.1 100 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:36.483 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:36.443+0000 12c56640 -1 osd.4 101 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:36.416695+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:37.251 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:37.193+0000 12c56640 -1 osd.1 100 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:37.878 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:37.876+0000 12c56640 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:37.527217+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:38.549 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:38.518+0000 12c56640 -1 osd.1 101 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:39.652 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:39.606+0000 12c56640 -1 osd.1 102 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:39.797 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:39.735+0000 12c56640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:38.791517+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:40.700 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:40.695+0000 12c56640 -1 osd.1 104 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:40.701 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:40.684+0000 ec4e640 -1 osd.0 103 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:40.794 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:40.757+0000 12c56640 -1 osd.4 105 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:38.791517+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:41.689 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:41.685+0000 ec4e640 -1 osd.0 103 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:41.773 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:41.772+0000 12c56640 -1 osd.4 106 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:40.800866+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:41.850 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:41.737+0000 12c56640 -1 osd.1 105 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:42.856 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:42.856 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [write 0~5 in=5b] tid 11 osd.3 2024-01-23T07:36:42.856 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:42.856 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 11 2024-01-23T07:36:42.856 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 15 client.4471.objecter _send_op 11 to 21.1 on osd.3 2024-01-23T07:36:42.856 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:11 21.1 21:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92) v8 -- 0x56500d5d43a0 con 0x56500d69a520 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.415+0000 7fbc05435780 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:35.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:36.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:36.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:36.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:36.508+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:37.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:37.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:37.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.857 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:38.507+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:38.507+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:38.507+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:38.592+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:39.507+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:39.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:39.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:40.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:40.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:40.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:41.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:41.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:41.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:42.858 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.855+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 16 ==== osd_map(93..105 src has 1..106) v4 ==== 7129+0+0 (crc 0 0 0) 0x7fbbfc0528e0 con 0x56500d69a520 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(93..105 src has 1..106) v4 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [93,105] > 92 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 93 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 93 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 94 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 94 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 95 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:42.859 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 95 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 96 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 96 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 97 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 97 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 98 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 98 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 99 2024-01-23T07:36:42.860 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:42.873 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:42.799+0000 12c56640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:40.800866+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:43.254 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:43.157+0000 ec4e640 -1 osd.0 105 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:43.508 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 99 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:43.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:43.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 100 2024-01-23T07:36:43.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:43.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 100 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:43.509 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:43.510 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 101 2024-01-23T07:36:43.510 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:43.510 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 101 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:43.510 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:43.510 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 102 2024-01-23T07:36:43.510 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:43.511 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 102 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:43.511 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:43.511 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 103 2024-01-23T07:36:43.511 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:43.511 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 103 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:43.512 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:43.512 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 104 2024-01-23T07:36:43.512 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:43.512 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 104 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:43.512 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:43.512 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 105 2024-01-23T07:36:43.513 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 10 client.4471.objecter checking op 11 2024-01-23T07:36:43.513 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 105 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:43.513 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:43.514 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:43.514 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:42.856+0000 7fbbf37fe640 20 client.4471.objecter 11 21.d3a59201 osd.3 exist [write 0~5 in=5b] 2024-01-23T07:36:43.514 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:43.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:43.514 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:43.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:43.982 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:43.969+0000 12c56640 -1 osd.4 108 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:43.897668+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:44.527 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:44.473+0000 ec4e640 -1 osd.0 108 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:45.030 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:44.991+0000 12c56640 -1 osd.4 110 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:43.897668+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:45.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:43.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:45.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:43.593+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:45.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:44.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:45.670 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:44.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:44.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 17 ==== osd_op_reply(11 exist [write 0~5] v105'4 uv4 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(11 exist [write 0~5] v105'4 uv4 ondisk = 0) v8 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 11 ondisk uv 4 in 21.1 attempt 0 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 11 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 11 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 11 2024-01-23T07:36:45.671 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc02c4d640 20 librados: complete_aio_write 0x56500d6921b0 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (10256 ms) 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 105 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 12 osd.3 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 12 2024-01-23T07:36:45.672 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 15 client.4471.objecter _send_op 12 to 21.1 on osd.3 2024-01-23T07:36:45.783 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:45.768+0000 ec4e640 -1 osd.0 108 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:46.198 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:46.034+0000 12c56640 -1 osd.4 110 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:43.897668+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:46.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:12 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e105) v8 -- 0x56500d78a0c0 con 0x56500d69a520 2024-01-23T07:36:46.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:46.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:46.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d78a420 2024-01-23T07:36:46.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 105 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 10 client.4471.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 13 osd.3 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 13 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 15 client.4471.objecter _send_op 13 to 21.1 on osd.3 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:13 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e105) v8 -- 0x56500d5d3d30 con 0x56500d69a520 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:45.670+0000 7fbc05435780 5 client.4471.objecter 2 in flight 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:46.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.508+0000 7fbbf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 18 ==== osd_map(106..109 src has 1..110) v4 ==== 1120+0+0 (crc 0 0 0) 0x7fbbfc063040 con 0x56500d69a520 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 19 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(106..109 src has 1..110) v4 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [106,109] > 105 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 106 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 12 2024-01-23T07:36:46.663 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 106 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 13 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 106 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 107 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 12 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 107 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 13 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 107 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:46.664 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 108 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 12 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 108 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 13 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 108 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 109 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 12 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 109 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 10 client.4471.objecter checking op 13 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 109 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.665 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter 12 21.d3a59201 osd.3 exist [read 0~0] 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbbf37fe640 20 client.4471.objecter 13 21.a7bbaa1 osd.3 noexist [read 0~0] 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (991 ms) 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 12 ondisk uv 4 in 21.1 attempt 0 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 5 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 12 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 12 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 12 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 5 client.4471.objecter 1 in flight 2024-01-23T07:36:46.666 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 20 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 13 ondisk uv 0 in 21.1 attempt 0 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 10 client.4471.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 13 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 13 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 13 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d78a0c0 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 109 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:46.667 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:46.668 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 14 osd.3 2024-01-23T07:36:46.668 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:46.668 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 14 2024-01-23T07:36:46.668 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 15 client.4471.objecter _send_op 14 to 21.1 on osd.3 2024-01-23T07:36:46.668 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:14 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v8 -- 0x56500d689390 con 0x56500d69a520 2024-01-23T07:36:47.049 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:47.010+0000 ec4e640 -1 osd.0 109 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:47.507 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:47.506+0000 12c56640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:46.565901+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:48.394 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:48.296+0000 ec4e640 -1 osd.0 110 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:48.700 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:48.699+0000 12c56640 -1 osd.4 112 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:46.565901+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:49.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:49.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d5d3d30 2024-01-23T07:36:49.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 109 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:49.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:49.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 10 client.4471.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 15 osd.3 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 15 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 15 client.4471.objecter _send_op 15 to 21.1 on osd.3 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:15 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v8 -- 0x56500d5d41d0 con 0x56500d69a520 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:46.661+0000 7fbc05435780 5 client.4471.objecter 2 in flight 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:47.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:47.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:49.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:47.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:48.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:48.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:48.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:48.594+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 21 ==== osd_map(110..110 src has 1..111) v4 ==== 304+0+0 (crc 0 0 0) 0x7fbbfc063040 con 0x56500d69a520 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 22 ==== osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(110..110 src has 1..111) v4 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(14 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [110,110] > 109 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 110 2024-01-23T07:36:49.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 10 client.4471.objecter checking op 14 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 110 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 10 client.4471.objecter checking op 15 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 110 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 20 client.4471.objecter 14 21.d3a59201 osd.3 exist [read 0~0] 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbbf37fe640 20 client.4471.objecter 15 21.a7bbaa1 osd.3 noexist [read 0~0] 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 14 ondisk uv 4 in 21.1 attempt 0 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 5 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 14 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 14 2024-01-23T07:36:49.285 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 14 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 5 client.4471.objecter 1 in flight 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 23 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 15 ondisk uv 0 in 21.1 attempt 0 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 10 client.4471.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 15 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 15 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 15 2024-01-23T07:36:49.286 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:49.287 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (2620 ms) 2024-01-23T07:36:49.287 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-01-23T07:36:49.287 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d78a0a0 2024-01-23T07:36:49.287 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 110 base exist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [read 0~0] tid 16 osd.3 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 16 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 15 client.4471.objecter _send_op 16 to 21.1 on osd.3 2024-01-23T07:36:49.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:16 21.1 21:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v8 -- 0x56500d689390 con 0x56500d69a520 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d5d11c0 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 110 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.a7bbaa1 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 10 client.4471.objecter _op_submit oid noexist '@21' '@21' [read 0~0] tid 17 osd.3 2024-01-23T07:36:49.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 17 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 15 client.4471.objecter _send_op 17 to 21.1 on osd.3 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:17 21.1 21:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v8 -- 0x56500d5d3d30 con 0x56500d69a520 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.281+0000 7fbc05435780 5 client.4471.objecter 2 in flight 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 25 ==== osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+5 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(16 exist [read 0~5 out=5b] v0'0 uv4 ondisk = 0) v8 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 16 ondisk uv 4 in 21.1 attempt 0 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 5 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 16 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 16 2024-01-23T07:36:49.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 5 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 16 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 5 client.4471.objecter 1 in flight 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 24 ==== osd_map(111..111 src has 1..111) v4 ==== 1016+0+0 (crc 0 0 0) 0x7fbbfc0054a0 con 0x56500d69a520 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(111..111 src has 1..111) v4 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 26 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [111,111] > 110 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 111 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 10 client.4471.objecter checking op 17 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 111 base noexist @21 precalc_pgid 0 pgid 0.0 is_read 2024-01-23T07:36:49.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target noexist @21 -> pgid 21.a7bbaa1 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbbf37fe640 20 client.4471.objecter 17 21.a7bbaa1 osd.3 noexist [read 0~0] 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 17 ondisk uv 0 in 21.1 attempt 0 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 10 client.4471.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 17 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 17 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 17 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (168 ms) 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-01-23T07:36:49.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 20 librados: queue_aio_write 0x56500d578690 completion 0x56500d78a7b0 write_seq 4 2024-01-23T07:36:49.456 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d78a0a0 2024-01-23T07:36:49.717 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:49.653+0000 ec4e640 -1 osd.0 111 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:49.784 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:49.748+0000 12c56640 -1 osd.1 112 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:50.970 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:50.959+0000 ec4e640 -1 osd.0 112 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:51.443 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:51.363+0000 12c56640 -1 osd.1 112 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:51.748 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 111 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:51.748 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:51.748 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 18 osd.3 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 18 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 15 client.4471.objecter _send_op 18 to 21.1 on osd.3 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:18 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x56500d689390 con 0x56500d69a520 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.450+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:49.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:50.508+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:50.508+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:51.749 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:50.508+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.509+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.509+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.509+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 27 ==== osd_op_reply(18 exist [writefull 0~5] v111'5 uv5 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(18 exist [writefull 0~5] v111'5 uv5 ondisk = 0) v8 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 18 ondisk uv 5 in 21.1 attempt 0 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 18 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 18 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 18 2024-01-23T07:36:51.750 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc02c4d640 20 librados: complete_aio_write 0x56500d78a7b0 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (2298 ms) 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 20 librados: queue_aio_write 0x56500d578690 completion 0x56500d689280 write_seq 5 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d78a0a0 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 111 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:51.838 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 19 osd.3 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 19 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 15 client.4471.objecter _send_op 19 to 21.1 on osd.3 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:19 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111) v8 -- 0x56500d689390 con 0x56500d69a520 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.748+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 28 ==== osd_map(112..113 src has 1..115) v4 ==== 1988+0+0 (crc 0 0 0) 0x7fbbfc004e30 con 0x56500d69a520 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(112..113 src has 1..115) v4 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [112,113] > 111 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 112 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 10 client.4471.objecter checking op 19 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 112 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:51.839 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:51.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 113 2024-01-23T07:36:51.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 10 client.4471.objecter checking op 19 2024-01-23T07:36:51.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 113 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:51.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:51.840 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:52.147 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:52.130+0000 12c56640 -1 osd.4 113 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:52.036247+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:52.247 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:52.106+0000 ec4e640 -1 osd.0 113 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:52.469 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:52.433+0000 12c56640 -1 osd.1 113 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:53.312 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:36:53.301+0000 12c56640 -1 osd.4 114 heartbeat_check: no reply from 172.21.15.116:6830 osd.2 since back 2024-01-23T07:36:52.036247+0000 front 2024-01-23T07:35:00.869734+0000 (oldest deadline 2024-01-23T07:36:29.903280+0000) 2024-01-23T07:36:53.379 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:53.357+0000 ec4e640 -1 osd.0 115 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:36:53.636 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:36:53.614+0000 12c56640 -1 osd.1 114 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4650.0:2 58.1b 58.780569b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40) 2024-01-23T07:36:53.660 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:51.837+0000 7fbbf37fe640 20 client.4471.objecter 19 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:36:53.660 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:52.509+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:53.660 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:52.509+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:52.509+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.509+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.509+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.509+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.595+0000 7fbc046b0640 10 client.4471.objecter tick 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1912 ms) 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 29 ==== osd_op_reply(19 exist [writefull 0~5] v113'6 uv6 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(19 exist [writefull 0~5] v113'6 uv6 ondisk = 0) v8 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 19 ondisk uv 6 in 21.1 attempt 0 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 19 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 19 2024-01-23T07:36:53.661 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 19 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc02c4d640 20 librados: complete_aio_write 0x56500d689280 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 20 librados: queue_aio_write 0x56500d578690 completion 0x56500d5d0af0 write_seq 6 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 10 client.4471.objecter _op_submit op 0x56500d689280 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 20 client.4471.objecter _calc_target epoch 113 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 10 client.4471.objecter _calc_target raw pgid 21.d3a59201 -> actual 21.1 acting [3,4] primary 3 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 20 client.4471.objecter _get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 10 client.4471.objecter _op_submit oid exist '@21' '@21' [writefull 0~5 in=5b] tid 20 osd.3 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 20 client.4471.objecter get_session s=0x56500d53f3f0 osd=3 3 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 15 client.4471.objecter _session_op_assign 3 20 2024-01-23T07:36:53.662 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 15 client.4471.objecter _send_op 20 to 21.1 on osd.3 2024-01-23T07:36:55.062 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- osd_op(unknown.0.0:20 21.1 21:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113) v8 -- 0x56500d78a0a0 con 0x56500d69a520 2024-01-23T07:36:55.062 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:55.062 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.660+0000 7fbc05435780 5 client.4471.objecter 1 in flight 2024-01-23T07:36:55.062 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 30 ==== osd_map(114..115 src has 1..116) v4 ==== 556+0+0 (crc 0 0 0) 0x7fbbfc005290 con 0x56500d69a520 2024-01-23T07:36:55.062 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_map(114..115 src has 1..116) v4 2024-01-23T07:36:55.062 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map got epochs [114,115] > 113 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 114 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 10 client.4471.objecter checking op 20 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 114 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 3 client.4471.objecter handle_osd_map decoding incremental epoch 115 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 10 client.4471.objecter checking op 20 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 20 client.4471.objecter _calc_target epoch 115 base exist @21 precalc_pgid 0 pgid 0.0 is_write 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 20 client.4471.objecter _calc_target target exist @21 -> pgid 21.d3a59201 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 20 client.4471.objecter dump_active .. 0 homeless 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:53.855+0000 7fbbf37fe640 20 client.4471.objecter 20 21.d3a59201 osd.3 exist [writefull 0~5 in=5b] 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:54.509+0000 7fbbf27fc640 10 monclient: tick 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:54.509+0000 7fbbf27fc640 10 monclient: _check_auth_tickets 2024-01-23T07:36:55.063 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:54.509+0000 7fbbf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 <== osd.3 v2:172.21.15.116:6818/1332739445 31 ==== osd_op_reply(20 exist [writefull 0~5] v115'7 uv7 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7fbbfc04f070 con 0x56500d69a520 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 10 client.4471.objecter ms_dispatch 0x56500d573560 osd_op_reply(20 exist [writefull 0~5] v115'7 uv7 ondisk = 0) v8 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 10 client.4471.objecter in handle_osd_op_reply 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 7 client.4471.objecter handle_osd_op_reply 20 ondisk uv 7 in 21.1 attempt 0 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 10 client.4471.objecter op 0 rval 0 len 0 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 15 client.4471.objecter handle_osd_op_reply completed tid 20 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 15 client.4471.objecter _finish_op 20 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 4 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 15 client.4471.objecter _session_op_remove 3 20 2024-01-23T07:36:55.064 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 5 client.4471.objecter 0 in flight 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 20 librados: complete_aio_write 0x56500d5d0af0 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1401 ms) 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 10 librados: watch_flush enter 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 10 librados: watch_flush exit 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 10 client.4471.objecter close_session for osd.3 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x56500d69a520 msgr2=0x56500d69a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x56500d69a520 0x56500d69a900 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 20 client.4471.objecter put_session s=0x56500d53f3f0 osd=3 1 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 20 client.4471.objecter shutdown clearing up homeless session... 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 10 client.4471.objecter successfully canceled tick 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbbe406ab50 msgr2=0x7fbbe406d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbbe406ab50 0x7fbbe406d010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800a590 tx=0x7fbbf800d000 comp rx=0 tx=0).stop 2024-01-23T07:36:55.067 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 10 monclient: shutdown 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 msgr2=0x56500d692870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 --2- 172.21.15.116:0/1263817588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56500d5fedb0 0x56500d692870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400ba80 tx=0x7fbbf400bf40 comp rx=0 tx=0).stop 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc02c4d640 1 -- 172.21.15.116:0/1263817588 reap_dead start 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 shutdown_connections 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.061+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 >> 172.21.15.116:0/1263817588 conn(0x56500d605cf0 msgr2=0x56500d699280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.062+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 shutdown_connections 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.062+0000 7fbc05435780 1 -- 172.21.15.116:0/1263817588 wait complete. 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.062+0000 7fbc05435780 1 librados: shutdown 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [----------] 12 tests from AsioRados (51595 ms total) 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: 2024-01-23T07:36:55.068 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [----------] Global test environment tear-down 2024-01-23T07:36:55.069 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (121634 ms total) 2024-01-23T07:36:55.069 INFO:tasks.workunit.client.0.smithi116.stdout: api_asio: [ PASSED ] 12 tests. 2024-01-23T07:36:55.112 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:04:43.491 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.119 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:04:43.498 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.187 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:04:43.523 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.189 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:04:43.525 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.194 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:04:43.574 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.196 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:04:43.576 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.322 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:04:43.701 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.447 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:04:43.826 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:55.681 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:04:44.017 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:36:58.634 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (125016 ms) 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (125016 ms total) 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (125016 ms total) 2024-01-23T07:36:58.635 INFO:tasks.workunit.client.0.smithi116.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-01-23T07:36:58.848 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:36:58.843+0000 12c56640 -1 osd.3 120 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.0.14:1 74.6 74.7fc1f406 (undecoded) ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected+supports_pool_eio e82) 2024-01-23T07:36:59.455 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:36:59.282+0000 ec4e640 -1 osd.0 120 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:00.420 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:00.410+0000 ec4e640 -1 osd.0 121 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:01.545 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:01.513+0000 ec4e640 -1 osd.0 121 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:02.407 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:02.219+0000 ec4e640 -1 osd.2 122 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4480.0:8 11.1b 11:dfad01c8:test-rados-api-smithi116-40947-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) 2024-01-23T07:37:03.084 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:02.872+0000 ec4e640 -1 osd.0 122 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:04.638 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:04.405+0000 ec4e640 -1 osd.2 123 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4480.0:8 11.1b 11:dfad01c8:test-rados-api-smithi116-40947-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) 2024-01-23T07:37:05.244 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:37:05.243+0000 12c56640 -1 osd.3 124 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.0.14:1 74.6 74.7fc1f406 (undecoded) ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected+supports_pool_eio e82) 2024-01-23T07:37:05.759 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:05.730+0000 ec4e640 -1 osd.0 124 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:06.374 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:06.075+0000 ec4e640 -1 osd.2 124 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4480.0:8 11.1b 11:dfad01c8:test-rados-api-smithi116-40947-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) 2024-01-23T07:37:07.049 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:37:06.809+0000 12c56640 -1 osd.3 125 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.0.14:1 74.6 74.7fc1f406 (undecoded) ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected+supports_pool_eio e82) 2024-01-23T07:37:07.259 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:07.034+0000 ec4e640 -1 osd.0 125 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:07.894 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:37:07.874+0000 12c56640 -1 osd.3 125 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.0.14:1 74.6 74.7fc1f406 (undecoded) ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected+supports_pool_eio e82) 2024-01-23T07:37:08.175 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:08.162+0000 ec4e640 -1 osd.0 125 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:08.893 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:37:08.887+0000 12c56640 -1 osd.3 125 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.0.14:1 74.6 74.7fc1f406 (undecoded) ondisk+read+rwordered+ignore_cache+ignore_overlay+map_snap_clone+known_if_redirected+supports_pool_eio e82) 2024-01-23T07:37:09.493 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:09.466+0000 ec4e640 -1 osd.2 126 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4480.0:8 11.1b 11:dfad01c8:test-rados-api-smithi116-40947-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) 2024-01-23T07:37:09.547 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:09.412+0000 ec4e640 -1 osd.0 126 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:10.442 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:10.428+0000 ec4e640 -1 osd.0 126 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:11.098 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:10.958+0000 ec4e640 -1 osd.2 126 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4480.0:8 11.1b 11:dfad01c8:test-rados-api-smithi116-40947-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) 2024-01-23T07:37:11.411 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:11.405+0000 ec4e640 -1 osd.0 126 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:12.990 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:12.770+0000 ec4e640 -1 osd.2 127 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4480.0:8 11.1b 11:dfad01c8:test-rados-api-smithi116-40947-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) 2024-01-23T07:37:13.155 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:13.057+0000 ec4e640 -1 osd.0 127 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:13.745 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:13.738+0000 ec4e640 -1 osd.2 127 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4480.0:8 11.1b 11:dfad01c8:test-rados-api-smithi116-40947-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) 2024-01-23T07:37:14.257 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:14.251+0000 ec4e640 -1 osd.0 127 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:14.797 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:37:14.774+0000 ec4e640 -1 osd.2 127 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4513.0:5 13.f 13:f3783faa:test-rados-api-smithi116-40912-3::foo:head [write 0~128 in=128b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: Running main() from gmock_main.cc 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [----------] Global test environment set-up. 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [ OK ] NeoRadosCls.DNE (36547 ms) 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (104704 ms) 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [----------] 2 tests from NeoRadosCls (141251 ms total) 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [----------] Global test environment tear-down 2024-01-23T07:37:14.928 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [==========] 2 tests from 1 test suite ran. (141251 ms total) 2024-01-23T07:37:14.929 INFO:tasks.workunit.client.0.smithi116.stdout: cls: [ PASSED ] 2 tests. 2024-01-23T07:37:15.263 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:15.250+0000 ec4e640 -1 osd.0 127 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:17.589 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:17.284+0000 ec4e640 -1 osd.0 128 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:18.361 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:37:18.348+0000 ec4e640 -1 osd.0 128 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4864.0:3 75.6 75:602f83fe:::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e78) 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (1221 ms) 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-01-23T07:37:23.323 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (320 ms) 2024-01-23T07:37:23.324 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-01-23T07:37:23.324 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (148272 ms) 2024-01-23T07:37:23.324 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (149813 ms total) 2024-01-23T07:37:23.324 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: 2024-01-23T07:37:23.324 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-01-23T07:37:23.324 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (149813 ms total) 2024-01-23T07:37:23.324 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: Running main() from gmock_main.cc 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [----------] Global test environment set-up. 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (6626 ms) 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (9622 ms) 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (134002 ms) 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [----------] 3 tests from NeoRadosCmd (150250 ms total) 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [----------] Global test environment tear-down 2024-01-23T07:37:23.963 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [==========] 3 tests from 1 test suite ran. (150250 ms total) 2024-01-23T07:37:23.964 INFO:tasks.workunit.client.0.smithi116.stdout: cmd: [ PASSED ] 3 tests. 2024-01-23T07:37:32.524 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-01-23T07:37:32.524 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-01-23T07:37:32.524 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-01-23T07:37:32.524 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-01-23T07:37:32.524 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-01-23T07:37:32.524 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-01-23T07:37:32.524 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (20435 ms) 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (10240 ms) 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (31167 ms) 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (14634 ms) 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (250 ms) 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (1326 ms) 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (1652 ms) 2024-01-23T07:37:32.525 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (39473 ms) 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (8821 ms) 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (1623 ms) 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (95 ms) 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (3278 ms) 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (439 ms) 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (6856 ms) 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-01-23T07:37:32.526 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (472 ms) 2024-01-23T07:37:32.527 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-01-23T07:37:32.527 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (107 ms) 2024-01-23T07:37:32.527 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (140868 ms total) 2024-01-23T07:37:32.527 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: 2024-01-23T07:37:32.527 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-01-23T07:37:32.527 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (158960 ms total) 2024-01-23T07:37:32.527 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-01-23T07:37:37.598 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: Running main() from gmock_main.cc 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [----------] Global test environment set-up. 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (1285 ms) 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (226 ms) 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (157714 ms) 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:24.782505+0000 mon.a [WRN] Health check update: Reduced data availability: 2 pgs inactive (PG_AVAILABILITY) 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:24.783211+0000 mon.a [WRN] Health check update: 1 slow ops, oldest one blocked for 67 sec, daemons [osd.0,osd.3] have slow ops. (SLOW_OPS) 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:25.293537+0000 mon.a [WRN] Health check update: 12 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-23T07:37:37.599 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:26.343285+0000 mon.a [INF] from='client.? 172.21.15.116:0/78362530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi116-40739-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:26.556049+0000 mon.a [INF] from='client.? 172.21.15.116:0/1944733952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi116-40954-7"}]: dispatch 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:26.588802+0000 mon.b [INF] from='client.? 172.21.15.116:0/3261614121' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi116-40616-10"}]: dispatch 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:27.000958+0000 mon.a [INF] from='client.? 172.21.15.116:0/254529465' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi116-41111-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:27.077437+0000 mon.a [INF] from='client.? 172.21.15.116:0/1944733952' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi116-40954-7"}]: dispatch 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:27.385360+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi116-40616-10"}]: dispatch 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:28.639548+0000 mon.a [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive) 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:28.647644+0000 mon.a [INF] Health check cleared: SLOW_OPS (was: 1 slow ops, oldest one blocked for 67 sec, daemons [osd.0,osd.3] have slow ops.) 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:29.183102+0000 mon.c [INF] from='client.? 172.21.15.116:0/1504439586' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi116-40552-16"}]: dispatch 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:30.078597+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi116-40802-4"}]': finished 2024-01-23T07:37:37.600 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:30.083170+0000 mon.a [INF] from='client.? 172.21.15.116:0/78362530' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi116-40739-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-23T07:37:45.397 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:30.673959+0000 mon.a [INF] from='client.? 172.21.15.116:0/78362530' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi116-40739-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi116-40739-10"}]: dispatch 2024-01-23T07:37:45.397 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:30.706775+0000 mon.a [INF] from='client.? 172.21.15.116:0/1944733952' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi116-40954-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:37:45.397 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:32.157265+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi116-40552-16"}]: dispatch 2024-01-23T07:37:45.397 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:31.360377+0000 mon.b [INF] from='client.? 172.21.15.116:0/953269809' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi116-40802-4", "tierpool": "test-rados-api-smithi116-40802-4-cache"}]: dispatch 2024-01-23T07:37:45.397 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:31.450455+0000 mon.b [INF] from='client.? 172.21.15.116:0/3261614121' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi116-40616-10"}]: dispatch 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:32.889725+0000 mon.a [WRN] Health check update: 13 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:33.187595+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi116-40802-4", "tierpool": "test-rados-api-smithi116-40802-4-cache"}]: dispatch 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:33.244908+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi116-40616-10"}]: dispatch 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:33.717933+0000 mon.a [INF] from='client.? 172.21.15.116:0/254529465' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi116-41111-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:33.721102+0000 mon.a [INF] from='client.? 172.21.15.116:0/1944733952' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi116-40954-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:34.304883+0000 mon.a [INF] from='client.? 172.21.15.116:0/1944733952' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi116-40954-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi116-40954-7"}]: dispatch 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:34.935824+0000 mon.a [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:35.262333+0000 mon.b [INF] from='client.? 172.21.15.116:0/3261614121' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi116-40616-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:35.297477+0000 mon.b [INF] from='client.? 172.21.15.116:0/2889815830' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:35.364131+0000 mon.c [INF] from='client.? 172.21.15.116:0/1504439586' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi116-40552-16"}]: dispatch 2024-01-23T07:37:45.398 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:35.518104+0000 mon.b [INF] from='client.? 172.21.15.116:0/406292879' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi116-40912-7"}]: dispatch 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:35.843374+0000 mon.c [INF] from='client.? api_list: [==========] Running 11 tests from 3 test suites. 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] Global test environment set-up. 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] 7 tests from LibRadosList 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosList.ListObjects (140891 ms) 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (3862 ms) 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-01-23T07:37:45.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset foo1,foo2,foo3 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo1 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo2 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo3 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset foo1,foo4,foo5 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo4 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo5 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo1 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset foo6,foo7 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo7 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo6 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns1:foo4 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns1:foo5 2024-01-23T07:37:45.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns2:foo7 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns2:foo6 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns1:foo1 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: :foo1 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: :foo2 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: :foo3 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (4381 ms) 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 1 0 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 10 0 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 13 0 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 7 0 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 14 0 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 0 0 2024-01-23T07:37:45.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 15 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 11 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 5 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 8 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 6 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 3 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 4 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 12 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 9 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 2 0 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (11525 ms) 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: x cursor=MIN 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=1 cursor=12:02547ec2:::1:head 2024-01-23T07:37:45.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=10 cursor=12:52ea6a34:::10:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=13 cursor=12:566253c9:::13:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=7 cursor=12:5c6b0b28:::7:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=14 cursor=12:62a1935d:::14:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=0 cursor=12:6cac518f:::0:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=15 cursor=12:863748b0:::15:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=11 cursor=12:89d3ae78:::11:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=5 cursor=12:b29083e3:::5:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=8 cursor=12:bd63b0f1:::8:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=6 cursor=12:c4fdafeb:::6:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=3 cursor=12:cfc208b3:::3:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=4 cursor=12:d83876eb:::4:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=12 cursor=12:de5d7c5f:::12:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=9 cursor=12:e960b815:::9:head 2024-01-23T07:37:45.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > oid=2 cursor=12:f905c69b:::2:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: FIRST> seek to MIN oid=1 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=1 cursor=12:02547ec2:::1:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:02547ec2:::1:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:02547ec2:::1:head -> 1 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=10 cursor=12:52ea6a34:::10:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:52ea6a34:::10:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:52ea6a34:::10:head -> 10 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=13 cursor=12:566253c9:::13:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:566253c9:::13:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:566253c9:::13:head -> 13 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=7 cursor=12:5c6b0b28:::7:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:5c6b0b28:::7:head 2024-01-23T07:37:45.912 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:5c6b0b28:::7:head -> 7 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : api_watch_notify: Running main() from gmock_main.cc 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify_test_cb 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (44639 ms) 2024-01-23T07:37:47.905 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94130212199856 err -107 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (93480 ms) 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94130212201904 err -107 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (3142 ms) 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 554050781185 cookie 94130213727536 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (288 ms) 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 554050781186 cookie 94130213766448 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (2394 ms) 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-01-23T07:37:47.906 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748480 cookie 94130213784352 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (631 ms) 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748480 cookie 94130213770768 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748480 cookie 94130213784352 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748480 cookie 94130213784352 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748480 cookie 94130213770768 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748481 cookie 94130213770768 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748481 cookie 94130213784352 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (948 ms) 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748482 cookie 94130213772816 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748483 cookie 94130213772816 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748483 cookie 94130213772816 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 558345748484 cookie 94130213772816 2024-01-23T07:37:47.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3152 ms) 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94130213772816 err -107 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_cb from 4480 notify_id 571230650369 cookie 94130213770768 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (8145 ms) 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94130213770768 err -107 2024-01-23T07:37:47.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1530 ms) 2024-01-23T07:37:51.161 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (15834oid=14 cursor=12:62a1935d:::14:head 2024-01-23T07:37:51.161 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:62a1935d:::14:head 2024-01-23T07:37:51.161 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:62a1935d:::14:head -> 14 2024-01-23T07:37:51.161 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=0 cursor=12:6cac518f:::0:head 2024-01-23T07:37:51.161 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:6cac518f:::0:head 2024-01-23T07:37:51.161 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:6cac518f:::0:head -> 0 2024-01-23T07:37:51.161 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=15 cursor=12:863748b0:::15:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:863748b0:::15:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:863748b0:::15:head -> 15 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=11 cursor=12:89d3ae78:::11:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:89d3ae78:::11:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:89d3ae78:::11:head -> 11 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=5 cursor=12:b29083e3:::5:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:b29083e3:::5:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:b29083e3:::5:head -> 5 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=8 cursor=12:bd63b0f1:::8:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:bd63b0f1:::8:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:bd63b0f1:::8:head -> 8 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=6 cursor=12:c4fdafeb:::6:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:c4fdafeb:::6:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:c4fdafeb:::6:head -> 6 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=3 cursor=12:cfc208b3:::3:head 2024-01-23T07:37:51.162 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:cfc208b3:::3:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:cfc208b3:::3:head -> 3 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=4 cursor=12:d83876eb:::4:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:d83876eb:::4:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:d83876eb:::4:head -> 4 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=12 cursor=12:de5d7c5f:::12:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:de5d7c5f:::12:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:de5d7c5f:::12:head -> 12 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=9 cursor=12:e960b815:::9:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:e960b815:::9:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:e960b815:::9:head -> 9 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : oid=2 cursor=12:f905c69b:::2:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:f905c69b:::2:head 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:f905c69b:::2:head -> 2 2024-01-23T07:37:51.163 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:02547ec2:::1:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:02547ec2:::1:head expected=12:02547ec2:::1:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:02547ec2:::1:head -> 1 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=1 expected=1 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:52ea6a34:::10:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:52ea6a34:::10:head expected=12:52ea6a34:::10:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:52ea6a34:::10:head -> 10 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=10 expected=10 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:6cac518f:::0:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:6cac518f:::0:head expected=12:6cac518f:::0:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:6cac518f:::0:head -> 0 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=0 expected=0 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:62a1935d:::14:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:62a1935d:::14:head expected=12:62a1935d:::14:head 2024-01-23T07:37:51.164 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:62a1935d:::14:head -> 14 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=14 expected=14 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:5c6b0b28:::7:head 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:5c6b0b28:::7:head expected=12:5c6b0b28:::7:head 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:5c6b0b28:::7:head -> 7 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=7 expected=7 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:566253c9:::13:head 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:566253c9:::13:head expected=12:566253c9:::13:head 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:566253c9:::13:head -> 13 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=13 expected=13 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:d83876eb:::4:head 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:d83876eb:::4:head expected=12:d83876eb:::4:head 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:d83876eb:::4:head -> 4 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=4 expected=4 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:cfc208b3:::3:head 2024-01-23T07:37:51.165 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:cfc208b3:::3:head expected=12:cfc208b3:::3:head 2024-01-23T07:37:51.166 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:cfc208b3:::3:head -> 3 2024-01-23T07:37:56.279 INFO:tasks.workunit.client.0.smithi116.stdout: api172.21.15.116:0/2521509370' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi116-40573-22"}]: dispatch 2024-01-23T07:37:56.279 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:37.504355+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi116-40552-16"}]: dispatch 2024-01-23T07:37:56.279 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:37.508561+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi116-40573-22"}]: dispatch 2024-01-23T07:37:56.279 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:38.084518+0000 client.admin [INF] onexx 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:38.146585+0000 mon.a [INF] from='client.? 172.21.15.116:0/78362530' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi116-40739-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi116-40739-10"}]': finished 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:38.148616+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi116-40802-4", "tierpool": "test-rados-api-smithi116-40802-4-cache"}]': finished 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:38.484978+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi116-40616-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:38.495674+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:38.505356+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi116-40912-7"}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:43.963566+0000 mon.b [INF] from='client.? 172.21.15.116:0/3261614121' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi116-40616-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi116-40616-10"}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:44.168033+0000 mon.b [INF] from='client.? 172.21.15.116:0/406292879' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi116-40912-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:44.315147+0000 mon.c [INF] from='client.? 172.21.15.116:0/2521509370' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi116-40573-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:45.201808+0000 mon.a [WRN] Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:45.438257+0000 mon.b [INF] from='client.? 172.21.15.116:0/2889815830' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:45.750509+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi116-40573-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:37:56.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:45.950426+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi116-40552-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-23T07:38:02.258 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:46.287834+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi116-40616-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi116-40616-10"}]: dispatch 2024-01-23T07:38:02.258 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:46.314101+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi116-40912-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-01-23T07:38:02.258 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:47.938677+0000 client.admin [INF] twoxx 2024-01-23T07:38:02.258 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:48.675458+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-01-23T07:38:02.258 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:47.438442+0000 mon.c [INF] from='client.? 172.21.15.116:0/1504439586' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi116-40552-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi116-40552-16"}]: dispatch 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:48.436168+0000 mon.c [INF] from='client.? 172.21.15.116:0/2859573261' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi116-40519-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:49.837510+0000 mon.b [INF] from='client.? 172.21.15.116:0/4184403043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi116-40947-12"}]: dispatch 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:50.066742+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi116-40552-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi116-40552-16"}]: dispatch 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:50.077837+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi116-40519-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:50.340200+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi116-40573-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:50.367978+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi116-40912-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:52.063992+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi116-40947-12"}]: dispatch 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:52.482711+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:52.273924+0000 mon.b [INF] from='client.? 172.21.15.116:0/406292879' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi116-40912-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi116-40912-7"}]: dispatch 2024-01-23T07:38:02.259 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:52.444533+0000 mon.c [INF] from='client.? 172.21.15.116:0/2521509370' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi116-40573-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi116-40573-22"}]: dispatch 2024-01-23T07:38:08.403 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:52.938305+0000 mon.b [INF] from='client.? 172.21.15.116:0/2105608731' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi116-40895-6","app": " list_parallel: process_1_[41376]: starting. 2024-01-23T07:38:08.403 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_1_[41376]: creating pool ceph_test_rados_list_parallel.smithi116-41335 2024-01-23T07:38:08.403 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_1_[41376]: created object 0... 2024-01-23T07:38:08.403 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_1_[41376]: created object 25... 2024-01-23T07:38:08.403 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_1_[41376]: created object 49... 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_1_[41376]: finishing. 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_1_[41376]: shutting down. 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_2_[41377]: starting. 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_2_[41377]: listing objects. 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_2_[41377]: listed object 0... 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_2_[41377]: listed object 25... 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_2_[41377]: saw 50 objects 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_2_[41377]: shutting down. 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_3_[66139]: starting. 2024-01-23T07:38:08.404 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_3_[66139]: creating pool ceph_test_rados_list_parallel.smithi116-41335 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_3_[66139]: created object 0... 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_3_[66139]: created object 25... 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_3_[66139]: created object 49... 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_3_[66139]: finishing. 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_3_[66139]: shutting down. 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_4_[66140]: starting. 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_4_[66140]: listing objects. 2024-01-23T07:38:08.405 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_4_[66140]: listed object 0... 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_4_[66140]: listed object 25... 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_4_[66140]: saw 46 objects 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_4_[66140]: shutting down. 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_5_[66141]: starting. 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_5_[66141]: removed 25 objects... 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_5_[66141]: removed half of the objects 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_5_[66141]: removed 50 objects... 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_5_[66141]: removed 50 objects 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_5_[66141]: shutting down. 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.406 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.407 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_6_[81044]: starting. 2024-01-23T07:38:08.407 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_6_[81044]: creating pool ceph_test_rados_list_parallel.smithi116-41335 2024-01-23T07:38:08.407 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_6_[81044]: created object 0... 2024-01-23T07:38:08.407 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_6_[81044]: created object 25... 2024-01-23T07:38:08.407 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_6_[81044]: created object 49... 2024-01-23T07:38:08.407 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_6_[81044]: finishing. 2024-01-23T07:38:08.407 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_6_[81044]: shutting down. 2024-01-23T07:38:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_7_[81045]: starting. 2024-01-23T07:38:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_7_[81045]: listing objects. 2024-01-23T07:38:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_7_[81045]: listed object 0... 2024-01-23T07:38:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_7_[81045]: listed object 25... 2024-01-23T07:38:08.408 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_7_[81045]: listed object 50... 2024-01-23T07:38:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_7_[81045]: saw 57 objects 2024-01-23T07:38:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_7_[81045]: shutting down. 2024-01-23T07:38:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_8_[81046]: starting. 2024-01-23T07:38:08.409 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_8_[81046]: added 25 objects... 2024-01-23T07:38:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_8_[81046]: added half of the objects 2024-01-23T07:38:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_8_[81046]: added 50 objects... 2024-01-23T07:38:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_8_[81046]: added 50 objects 2024-01-23T07:38:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_8_[81046]: shutting down. 2024-01-23T07:38:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:08.410 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:38:09.359 INFO:tasks.ceph.mon.b.smithi173.stderr:2024-01-23T07:38:09.284+0000 10181640 -1 mon.b@1(peon).paxos(paxos updating c 1..488) lease_expire from mon.0 v2:172.21.15.116:3300/0 is 0.969004869s seconds in the past; mons are probably laggy (or possibly clocks are too skewed) 2024-01-23T07:38:13.763 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:02.142 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:13.773 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:02.153 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:14.180 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:02.559 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:14.235 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:02.615 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:14.246 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:02.625 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:14.643 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:03.022 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:16.417 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:04.753 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:16.424 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:04.760 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:16.697 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:05.033 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ********************** open_pools_parallel: process_1_[41328]: starting. 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_1_[41328]: creating pool ceph_test_rados_open_pools_parallel.smithi116-41285 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_1_[41328]: created object 0... 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_1_[41328]: created object 25... 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_1_[41328]: created object 49... 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_1_[41328]: finishing. 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_1_[41328]: shutting down. 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_2_[41330]: starting. 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_2_[41330]: rados_pool_create. 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_2_[41330]: rados_ioctx_create. 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_2_[41330]: shutting down. 2024-01-23T07:38:17.071 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: ******************************* 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_3_[71669]: starting. 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_3_[71669]: creating pool ceph_test_rados_open_pools_parallel.smithi116-41285 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_3_[71669]: created object 0... 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_3_[71669]: created object 25... 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_3_[71669]: created object 49... 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_3_[71669]: finishing. 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_3_[71669]: shutting down. 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: ******************************* 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_4_[71670]: starting. 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_4_[71670]: rados_pool_create. 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_4_[71670]: rados_ioctx_create. 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: process_4_[71670]: shutting down. 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: ******************************* 2024-01-23T07:38:17.072 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: ******************************* 2024-01-23T07:38:17.073 INFO:tasks.workunit.client.0.smithi116.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: seed 40739 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (71485 ms) 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (14718 ms) 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (18853 ms) 2024-01-23T07:38:17.097 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (5093 ms) 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (8329 ms) 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (5840 ms) 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (4010 ms) 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (2154 ms) 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (130483 ms total) 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (10527 ms) 2024-01-23T07:38:17.098 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (317 ms) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1226 ms) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (2320 ms) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (961 ms) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (408 ms) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (256 ms) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (172 ms) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (16187 ms total) 2024-01-23T07:38:17.099 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: 2024-01-23T07:38:17.100 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-01-23T07:38:17.100 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (203734 ms total) 2024-01-23T07:38:17.100 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-01-23T07:38:18.165 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_1_[41374]: starting. 2024-01-23T07:38:18.165 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_1_[41374]: creating pool ceph_test_rados_delete_pools_parallel.smithi116-41351 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_1_[41374]: created object 0... 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_1_[41374]: created object 25... 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_1_[41374]: created object 49... 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_1_[41374]: finishing. 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_1_[41374]: shutting down. 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_2_[41375]: starting. 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_2_[41375]: deleting pool ceph_test_rados_delete_pools_parallel.smithi116-41351 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_2_[41375]: shutting down. 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: ******************************* 2024-01-23T07:38:18.166 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_3_[71453]: starting. 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_3_[71453]: creating pool ceph_test_rados_delete_pools_parallel.smithi116-41351 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_3_[71453]: created object 0... 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_3_[71453]: created object 25... 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_3_[71453]: created object 49... 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_3_[71453]: finishing. 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_3_[71453]: shutting down. 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: ******************************* 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_5_[71455]: starting. 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_5_[71455]: listing objects. 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_5_[71455]: listed object 0... 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_5_[71455]: listed object 25... 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_5_[71455]: saw 50 objects 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_5_[71455]: shutting down. 2024-01-23T07:38:18.167 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: ******************************* 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_4_[71454]: starting. 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_4_[71454]: deleting pool ceph_test_rados_delete_pools_parallel.smithi116-41351 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: process_4_[71454]: shutting down. 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: ******************************* 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: ******************************* 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout:0x55e8ac87b1d0 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad100260 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1b5480 2024-01-23T07:38:18.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1b5590 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1b56a0 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1b57b0 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87bb10 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87bc20 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87b450 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87bd70 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87bec0 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad101ad0 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad102120 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1b46c0 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ac87b670 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad0ffda0 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad102770 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1030c0 2024-01-23T07:38:18.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad100370 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad100ce0 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad101650 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1017a0 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1018b0 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: waiting 0x55e8ad1019c0 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: done. 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (89049 ms) 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (89049 ms total) 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-01-23T07:38:18.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.Exec (5277 ms) 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (20252 ms) 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2495 ms) 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.Applications (6837 ms) 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-01-23T07:38:18.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-01-23T07:38:18.172 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (74202 ms) 2024-01-23T07:38:18.172 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] 8 tests from LibRadosMisc (109064 ms total) 2024-01-23T07:38:18.172 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: 2024-01-23T07:38:18.172 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [----------] Global test environment tear-down 2024-01-23T07:38:18.172 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (204765 ms total) 2024-01-23T07:38:18.172 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc: [ PASSED ] 12 tests. 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: Running main() from gmock_main.cc 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [----------] Global test environment set-up. 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStat.Stat (26906 ms) 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-01-23T07:38:19.310 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (19996 ms) 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStat.StatNS (82737 ms) 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (2190 ms) 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (2030 ms) 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [----------] 5 tests from LibRadosStat (133859 ms total) 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (8822 ms) 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (710 ms) 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-01-23T07:38:19.311 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (971 ms) 2024-01-23T07:38:19.312 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-01-23T07:38:19.312 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (4602 ms) 2024-01-23T07:38:19.312 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (15105 ms total) 2024-01-23T07:38:19.312 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: 2024-01-23T07:38:19.312 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [----------] Global test environment tear-down 2024-01-23T07:38:19.312 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (205837 ms total) 2024-01-23T07:38:19.312 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat: [ PASSED ] 9 tests. 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout:rados","yes_i_really_mean_it": true}]: dispatch 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:53.446289+0000 mon.a [WRN] Health check update: 15 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:54.060776+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi116-40573-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi116-40573-22"}]: dispatch 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:54.457422+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi116-40616-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi116-40616-10"}]': finished 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:54.460553+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi116-40519-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:54.940600+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi116-40912-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi116-40912-7"}]: dispatch 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:54.982826+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi116-40895-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:56.576837+0000 mon.a [INF] from='client.? 172.21.15.116:0/1476961219' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi116-41111-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-01-23T07:38:19.636 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:56.179076+0000 mon.b [INF] from='client.? 172.21.15.116:0/2889815830' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:56.255848+0000 mon.b [INF] from='client.? 172.21.15.116:0/4184403043' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi116-40947-12"}]: dispatch 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:57.701771+0000 mon.a [WRN] Health check update: Slow OSD heartbeats on back (longest 23576.606ms) (OSD_SLOW_PING_TIME_BACK) 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:58.021067+0000 client.admin [INF] threexx 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:58.032372+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:58.045485+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi116-40947-12"}]: dispatch 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:58.695558+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi116-40552-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi116-40552-16"}]': finished 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:37:58.713597+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi116-40895-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: got: 2024-01-23T07:38:00.323893+0000 mon.a [INF] from='client.? 172.21.15.116:0/78362530' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi116-40739-10"}]: dispatch 2024-01-23T07:38:19.637 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (46870 ms) 2024-01-23T07:38:19.638 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (206095 ms total) 2024-01-23T07:38:19.638 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: 2024-01-23T07:38:19.638 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [----------] Global test environment tear-down 2024-01-23T07:38:19.639 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (206095 ms total) 2024-01-23T07:38:19.639 INFO:tasks.workunit.client.0.smithi116.stdout: api_cmd: [ PASSED ] 4 tests. 2024-01-23T07:38:34.967 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-01-23T07:38:34.967 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-01-23T07:38:34.967 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: seed 40912 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (56978 ms) 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (78662 ms) 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (1328 ms) 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (1905 ms) 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-01-23T07:38:34.968 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (2143 ms) 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (141016 ms total) 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (9930 ms) 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (67 ms) 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (1745 ms) 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (7159 ms) 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (18901 ms total) 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: 2024-01-23T07:38:34.969 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-01-23T07:38:34.970 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (221525 ms total) 2024-01-23T07:38:34.970 INFO:tasks.workunit.client.0.smithi116.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-01-23T07:38:36.457 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:24.836 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.530 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:24.909 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.539 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:24.875 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.544 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:24.880 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.580 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:24.960 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.619 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:24.998 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.640 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:25.020 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.667 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:25.003 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:36.734 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:25.114 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:42.556 INFO:tasks.workunit.client.0.smithi116.stdout:9 ms total) 2024-01-23T07:38:42.556 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: 2024-01-23T07:38:42.557 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-01-23T07:38:42.557 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-01-23T07:38:42.557 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: watch_notify_test_cb 2024-01-23T07:38:42.557 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (20321 ms) 2024-01-23T07:38:42.557 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (20321 ms total) 2024-01-23T07:38:42.557 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: 2024-01-23T07:38:42.557 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-01-23T07:38:42.558 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (229102 ms total) 2024-01-23T07:38:42.558 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-01-23T07:38:47.640 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: Running main() from gmock_main.cc 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [----------] Global test environment set-up. 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (28401 ms) 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.LockShared (93909 ms) 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (7454 ms) 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1167 ms) 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-01-23T07:38:47.641 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (117 ms) 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.Unlock (2357 ms) 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (859 ms) 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (612 ms) 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [----------] 8 tests from LibRadosLock (134876 ms total) 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (17755 ms) 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (251 ms) 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-01-23T07:38:47.642 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (7585 ms) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (7216 ms) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (4516 ms) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (4504 ms) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (3055 ms) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (2030 ms) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (46912 ms total) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [----------] Global test environment tear-down 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (234334 ms total) 2024-01-23T07:38:47.643 INFO:tasks.workunit.client.0.smithi116.stdout: api_lock: [ PASSED ] 16 tests. 2024-01-23T07:38:56.654 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:45.033 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:56.727 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:45.107 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:56.768 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:45.147 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:56.775 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:45.154 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:56.788 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:45.124 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:56.795 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:45.132 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:56.879 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:06:45.259 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:56.900 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:06:45.237 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:38:57.016 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:06:45.396 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:02.695 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: Running main() from gmock_main.cc 2024-01-23T07:39:02.695 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-01-23T07:39:02.695 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [----------] Global test environment set-up. 2024-01-23T07:39:02.695 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-01-23T07:39:02.695 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: seed 40573 2024-01-23T07:39:02.696 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-01-23T07:39:02.696 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-01-23T07:39:02.696 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-01-23T07:39:02.696 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (31160 ms) 2024-01-23T07:39:02.696 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-01-23T07:39:02.696 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (5233 ms) 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (55455 ms) 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (4080 ms) 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (1669 ms) 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (27033 ms) 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (8123 ms) 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-01-23T07:39:02.697 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (203 ms) 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (629 ms) 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (79 ms) 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (925 ms) 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (2744 ms) 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (106 ms) 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (856 ms) 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-01-23T07:39:02.698 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (2182 ms) 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (455 ms) 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (217 ms) 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (109 ms) 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (227 ms) 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (141485 ms total) 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (15100 ms) 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-01-23T07:39:02.699 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (28254 ms) 2024-01-23T07:39:02.700 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-01-23T07:39:02.700 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (2754 ms) 2024-01-23T07:39:02.700 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-01-23T07:39:02.700 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (2455 ms) 2024-01-23T07:39:02.700 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.R api_io: Running main() from gmock_main.cc 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [----------] Global test environment set-up. 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (40848 ms) 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-01-23T07:39:09.948 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (11784 ms) 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (33441 ms) 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.Checksum (3050 ms) 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (14275 ms) 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (16077 ms) 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (8771 ms) 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (728 ms) 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-01-23T07:39:09.949 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.TruncTest (1161 ms) 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (224 ms) 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (1645 ms) 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.RmXattr (5913 ms) 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIo.XattrIter (121 ms) 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [----------] 14 tests from LibRadosIo (138039 ms total) 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (12898 ms) 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-01-23T07:39:09.950 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (385 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (379 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (4603 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (13577 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (5440 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (12384 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (4726 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (6504 ms) 2024-01-23T07:39:09.951 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-01-23T07:39:09.952 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (3181 ms) 2024-01-23T07:39:09.952 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [----------] 10 tests from LibRadosIoEC (64077 ms total) 2024-01-23T07:39:09.952 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: 2024-01-23T07:39:09.952 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [----------] Global test environment tear-down 2024-01-23T07:39:09.952 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [==========] 24 tests from 2 test suites ran. (256658 ms total) 2024-01-23T07:39:09.952 INFO:tasks.workunit.client.0.smithi116.stdout: api_io: [ PASSED ] 24 tests. 2024-01-23T07:39:16.777 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:05.156 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.783 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:05.162 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.783 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:05.119 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.794 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:05.130 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.816 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:05.196 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.874 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:05.253 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.885 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:05.221 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.915 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:05.293 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:16.967 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:05.347 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:31.104 INFO:tasks.workunit.client.0.smithi116.stdout:********* 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_9_[94480]: starting. 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_9_[94480]: creating pool ceph_test_rados_list_parallel.smithi116-41335 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_9_[94480]: created object 0... 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_9_[94480]: created object 25... 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_9_[94480]: created object 49... 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_9_[94480]: finishing. 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_9_[94480]: shutting down. 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: starting. 2024-01-23T07:39:31.105 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: listing objects. 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: listed object 0... 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: listed object 25... 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: listed object 50... 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: listed object 75... 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: saw 96 objects 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_10_[94481]: shutting down. 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_13_[94487]: starting. 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_13_[94487]: removed 25 objects... 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_13_[94487]: removed half of the objects 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_13_[94487]: removed 50 objects... 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_13_[94487]: removed 50 objects 2024-01-23T07:39:31.106 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_13_[94487]: shutting down. 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_12_[94486]: starting. 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_12_[94486]: added 25 objects... 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_12_[94486]: added half of the objects 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_12_[94486]: added 50 objects... 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_12_[94486]: added 50 objects 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_12_[94486]: shutting down. 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_11_[94482]: starting. 2024-01-23T07:39:31.107 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_11_[94482]: added 25 objects... 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_11_[94482]: added half of the objects 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_11_[94482]: added 50 objects... 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_11_[94482]: added 50 objects 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_11_[94482]: shutting down. 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_14_[102459]: starting. 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_14_[102459]: creating pool ceph_test_rados_list_parallel.smithi116-41335 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_14_[102459]: created object 0... 2024-01-23T07:39:31.108 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_14_[102459]: created object 25... 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_14_[102459]: created object 49... 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_14_[102459]: finishing. 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_14_[102459]: shutting down. 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: starting. 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: listing objects. 2024-01-23T07:39:31.109 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: listed object 0... 2024-01-23T07:39:37.010 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:25.389 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.077 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:25.456 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.152 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:25.488 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.165 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:25.501 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.189 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:25.569 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.215 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:25.595 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.218 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:25.598 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.258 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:25.594 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:37.302 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:25.681 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: list io: Running main() from gmock_main.cc 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [----------] Global test environment set-up. 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [----------] 14 tests from NeoRadosIo 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.Limits (58243 ms) 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (53150 ms) 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-01-23T07:39:43.480 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.ReadOp (38561 ms) 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.SparseRead (28509 ms) 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.RoundTrip (25982 ms) 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (13366 ms) 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (14163 ms) 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (6883 ms) 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (10649 ms) 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-01-23T07:39:43.481 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.Trunc (7950 ms) 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.Remove (8352 ms) 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (13674 ms) 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.RmXattr (5663 ms) 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ OK ] NeoRadosIo.GetXattrs (4606 ms) 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [----------] 14 tests from NeoRadosIo (289751 ms total) 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [----------] Global test environment tear-down 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [==========] 14 tests from 1 test suite ran. (289751 ms total) 2024-01-23T07:39:43.482 INFO:tasks.workunit.client.0.smithi116.stdout: io: [ PASSED ] 14 tests. 2024-01-23T07:39:53.453 INFO:tasks.workunit.client.0.smithi116.stdout:oundTripPP2 (2220 ms) 2024-01-23T07:39:53.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-01-23T07:39:53.453 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (1485 ms) 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (1334 ms) 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (864 ms) 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (4335 ms) 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (4966 ms) 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (2707 ms) 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (962 ms) 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-01-23T07:39:53.454 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (19637 ms) 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (3662 ms) 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (4977 ms) 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (2435 ms) 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (408 ms) 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (98555 ms total) 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [----------] Global test environment tear-down 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (300160 ms total) 2024-01-23T07:39:53.455 INFO:tasks.workunit.client.0.smithi116.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-01-23T07:39:57.580 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:45.959 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.584 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:45.964 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.647 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:45.983 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.650 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:46.029 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.657 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:46.034 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.658 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:45.994 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.702 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:46.081 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.749 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:46.085 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:57.760 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:46.140 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:39:58.895 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: Running main() from gmock_main.cc 2024-01-23T07:39:58.895 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-01-23T07:39:58.896 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [----------] Global test environment set-up. 2024-01-23T07:39:58.896 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-01-23T07:39:58.896 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-01-23T07:39:58.896 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (21544 ms) 2024-01-23T07:39:58.896 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-01-23T07:39:58.896 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (120552 ms) 2024-01-23T07:39:58.897 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-01-23T07:39:58.897 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (34488 ms) 2024-01-23T07:39:58.897 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-01-23T07:39:58.897 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (40101 ms) 2024-01-23T07:39:58.897 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-01-23T07:39:58.897 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (22125 ms) 2024-01-23T07:39:58.898 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-01-23T07:39:58.898 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (11685 ms) 2024-01-23T07:39:58.898 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-01-23T07:39:58.898 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (4560 ms) 2024-01-23T07:39:58.898 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-01-23T07:39:58.898 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (8516 ms) 2024-01-23T07:39:58.898 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-01-23T07:39:58.899 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (6767 ms) 2024-01-23T07:39:58.899 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-01-23T07:39:58.899 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (7179 ms) 2024-01-23T07:39:58.899 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-01-23T07:39:58.899 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (9626 ms) 2024-01-23T07:39:58.899 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-01-23T07:39:58.900 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (6363 ms) 2024-01-23T07:39:58.900 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-01-23T07:39:58.900 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (4133 ms) 2024-01-23T07:39:58.900 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-01-23T07:39:58.900 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (7472 ms) 2024-01-23T07:39:58.900 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (305111 ms total) 2024-01-23T07:39:58.901 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: 2024-01-23T07:39:58.901 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [----------] Global test environment tear-down 2024-01-23T07:39:58.901 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (305111 ms total) 2024-01-23T07:39:58.901 INFO:tasks.workunit.client.0.smithi116.stdout: read_operations: [ PASSED ] 14 tests. 2024-01-23T07:39:58.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: Running main() from gmock_main.cc 2024-01-23T07:39:58.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-01-23T07:39:58.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] Global test environment set-up. 2024-01-23T07:39:58.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-01-23T07:39:58.907 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (35091 ms) 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (7483 ms) 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (64120 ms) 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (44468 ms) 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (151162 ms total) 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-01-23T07:39:58.908 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (28197 ms) 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (12150 ms) 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (7980 ms) 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (48327 ms total) 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (8307 ms) 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (3558 ms) 2024-01-23T07:39:58.909 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (10698 ms) 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (3105 ms) 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (25669 ms total) 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (16044 ms) 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (11928 ms) 2024-01-23T07:39:58.910 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (27972 ms total) 2024-01-23T07:39:58.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: 2024-01-23T07:39:58.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [----------] Global test environment tear-down 2024-01-23T07:39:58.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (305484 ms total) 2024-01-23T07:39:58.911 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout:ed object 25... 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: listed object 50... 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: listed object 75... 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: listed object 100... 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: listed object 125... 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: saw 150 objects 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_15_[102463]: shutting down. 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.786 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_16_[102464]: starting. 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_16_[102464]: added 25 objects... 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_16_[102464]: added half of the objects 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_16_[102464]: added 50 objects... 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_16_[102464]: added 50 objects 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: process_16_[102464]: shutting down. 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******************************* 2024-01-23T07:39:59.787 INFO:tasks.workunit.client.0.smithi116.stdout: list_parallel: ******* SUCCESS ********** 2024-01-23T07:40:00.904 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:49.283 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:00.907 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:49.286 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:01.007 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:07:49.386 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:01.067 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:49.403 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:01.068 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:49.404 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:01.075 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:49.455 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:01.079 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:49.459 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:01.102 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:07:49.438 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:01.108 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:07:49.488 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:03.474 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: Running main() from gmock_main.cc 2024-01-23T07:40:03.475 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-01-23T07:40:03.475 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [----------] Global test environment set-up. 2024-01-23T07:40:03.475 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-01-23T07:40:03.475 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-01-23T07:40:03.475 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (72108 ms) 2024-01-23T07:40:03.475 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-01-23T07:40:03.475 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (27565 ms) 2024-01-23T07:40:03.476 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-01-23T07:40:03.476 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (62057 ms) 2024-01-23T07:40:03.476 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-01-23T07:40:03.476 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (43854 ms) 2024-01-23T07:40:03.476 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-01-23T07:40:03.476 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (17009 ms) 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (222594 ms total) 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (6192 ms) 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (15395 ms) 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (25105 ms) 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (8361 ms) 2024-01-23T07:40:03.477 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (9495 ms) 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi116-41698-11. 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: Waiting for snaps to purge. 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (22557 ms) 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (87105 ms total) 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [----------] Global test environment tear-down 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (309699 ms total) 2024-01-23T07:40:03.478 INFO:tasks.workunit.client.0.smithi116.stdout: snapshots: [ PASSED ] 11 tests. 2024-01-23T07:40:05.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-01-23T07:40:05.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-01-23T07:40:05.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-01-23T07:40:05.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-01-23T07:40:05.841 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: seed 40829 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (60679 ms) 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (21175 ms) 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (24835 ms) 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (32338 ms) 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (41812 ms) 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (180840 ms total) 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-01-23T07:40:05.842 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (21521 ms) 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (16995 ms) 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (15078 ms) 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (7622 ms) 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (9397 ms) 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-779-g1d156303/rpm/el9/BUILD/ceph-19.0.0-779-g1d156303/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-01-23T07:40:05.843 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi116-40829-7 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: waiting for snaps to purge 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (19455 ms) 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (90068 ms total) 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (5 ms) 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5210 ms) 2024-01-23T07:40:05.844 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5215 ms total) 2024-01-23T07:40:05.845 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: 2024-01-23T07:40:05.845 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-01-23T07:40:05.845 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-01-23T07:40:05.845 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3726 ms) 2024-01-23T07:40:05.845 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-01-23T07:40:17.729 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:06.108 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.735 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:06.114 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.790 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:06.169 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.798 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:06.177 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.805 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:06.141 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.810 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:06.146 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.855 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:06.235 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.878 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:06.214 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:17.936 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:06.315 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] Li api_aio: Running main() from gmock_main.cc 2024-01-23T07:40:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-01-23T07:40:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [----------] Global test environment set-up. 2024-01-23T07:40:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-01-23T07:40:24.126 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.TooBig (5162 ms) 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (86439 ms) 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (20220 ms) 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (47574 ms) 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (41276 ms) 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (13261 ms) 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (13435 ms) 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-01-23T07:40:24.127 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (5055 ms) 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (10940 ms) 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (7632 ms) 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (5673 ms) 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (5074 ms) 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (5574 ms) 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (5650 ms) 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-01-23T07:40:24.128 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.Flush (5175 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (7452 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (6596 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (4956 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (5027 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (5420 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3920 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3629 ms) 2024-01-23T07:40:24.129 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3402 ms) 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3969 ms) 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (4041 ms) 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (4296 ms) 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [----------] 26 tests from LibRadosAio (330848 ms total) 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: 2024-01-23T07:40:24.130 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-01-23T07:40:37.794 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:26.173 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.799 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:26.178 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.853 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:26.232 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.855 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:26.235 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.856 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:26.192 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.860 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:26.196 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.860 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:26.239 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.863 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.SimplbRadosSnapshotsECPP.SnapRemovePP (3338 ms) 2024-01-23T07:40:37.863 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-01-23T07:40:37.863 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (4639 ms) 2024-01-23T07:40:37.863 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-01-23T07:40:37.863 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2037 ms) 2024-01-23T07:40:37.863 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (13740 ms total) 2024-01-23T07:40:37.863 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4664 ms) 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (6271 ms) 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (5035 ms) 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (15970 ms total) 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-01-23T07:40:37.864 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (344462 ms total) 2024-01-23T07:40:37.865 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-01-23T07:40:37.865 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-01-23T07:40:37.865 INFO:tasks.workunit.client.0.smithi116.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-01-23T07:40:37.914 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:26.250 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:37.918 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:26.298 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: Running main() from gmock_main.cc 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: [----------] Global test environment set-up. 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: [----------] 3 tests from NeoradosList 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: [ OK ] NeoradosList.ListObjects (103757 ms) 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-01-23T07:40:42.410 INFO:tasks.workunit.client.0.smithi116.stdout: list: [ OK ] NeoradosList.ListObjectsNS (53312 ms) 2024-01-23T07:40:42.411 INFO:tasks.workunit.client.0.smithi116.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-01-23T07:40:42.411 INFO:tasks.workunit.client.0.smithi116.stdout: list: [ OK ] NeoradosList.ListObjectsMany (191586 ms) 2024-01-23T07:40:42.411 INFO:tasks.workunit.client.0.smithi116.stdout: list: [----------] 3 tests from NeoradosList (348655 ms total) 2024-01-23T07:40:42.411 INFO:tasks.workunit.client.0.smithi116.stdout: list: 2024-01-23T07:40:42.411 INFO:tasks.workunit.client.0.smithi116.stdout: list: [----------] Global test environment tear-down 2024-01-23T07:40:42.411 INFO:tasks.workunit.client.0.smithi116.stdout: list: [==========] 3 tests from 1 test suite ran. (348655 ms total) 2024-01-23T07:40:42.411 INFO:tasks.workunit.client.0.smithi116.stdout: list: [ PASSED ] 3 tests. 2024-01-23T07:40:57.791 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:46.170 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.795 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:46.174 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.852 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:46.188 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.855 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:46.191 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.869 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:46.249 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.875 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:46.254 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.908 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:08:46.287 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.919 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:08:46.255 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:40:57.932 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:08:46.312 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:12.139 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: Running main() from gmock_main.cc 2024-01-23T07:41:12.139 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-01-23T07:41:12.139 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [----------] Global test environment set-up. 2024-01-23T07:41:12.139 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-01-23T07:41:12.140 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-01-23T07:41:12.140 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (10216 ms) 2024-01-23T07:41:12.140 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-01-23T07:41:12.140 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (368188 ms) 2024-01-23T07:41:12.140 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (378404 ms total) 2024-01-23T07:41:12.140 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: 2024-01-23T07:41:12.141 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [----------] Global test environment tear-down 2024-01-23T07:41:12.141 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (378404 ms total) 2024-01-23T07:41:12.141 INFO:tasks.workunit.client.0.smithi116.stdout: ec_io: [ PASSED ] 2 tests. 2024-01-23T07:41:17.997 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:06.376 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.062 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:06.441 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.116 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:06.451 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.123 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:06.456 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.161 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:06.540 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.191 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:06.527 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.216 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:06.596 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.225 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:06.605 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:18.291 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:06.671 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout:_list: : entry=3 expected=3 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:c4fdafeb:::6:head 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:c4fdafeb:::6:head expected=12:c4fdafeb:::6:head 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:c4fdafeb:::6:head -> 6 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=6 expected=6 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:bd63b0f1:::8:head 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:bd63b0f1:::8:head expected=12:bd63b0f1:::8:head 2024-01-23T07:41:21.571 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:bd63b0f1:::8:head -> 8 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=8 expected=8 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:b29083e3:::5:head 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:b29083e3:::5:head expected=12:b29083e3:::5:head 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:b29083e3:::5:head -> 5 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=5 expected=5 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:89d3ae78:::11:head 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:89d3ae78:::11:head expected=12:89d3ae78:::11:head 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:89d3ae78:::11:head -> 11 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=11 expected=11 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:863748b0:::15:head 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:863748b0:::15:head expected=12:863748b0:::15:head 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:863748b0:::15:head -> 15 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=15 expected=15 2024-01-23T07:41:21.572 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:f905c69b:::2:head 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:f905c69b:::2:head expected=12:f905c69b:::2:head 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:f905c69b:::2:head -> 2 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=2 expected=2 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:e960b815:::9:head 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:e960b815:::9:head expected=12:e960b815:::9:head 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:e960b815:::9:head -> 9 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=9 expected=9 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : seek to 12:de5d7c5f:::12:head 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : cursor()=12:de5d7c5f:::12:head expected=12:de5d7c5f:::12:head 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: > 12:de5d7c5f:::12:head -> 12 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: : entry=12 expected=12 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (17378 ms) 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-01-23T07:41:21.573 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (176378 ms) 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: split 0/5 -> MIN 12:33333333::::head 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: split 1/5 -> 12:33333333::::head 12:66666666::::head 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: split 2/5 -> 12:66666666::::head 12:99999999::::head 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: split 3/5 -> 12:99999999::::head 12:cccccccc::::head 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: split 4/5 -> 12:cccccccc::::head MAX 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (15878 ms) 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] 7 tests from LibRadosList (370293 ms total) 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1977 ms) 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-01-23T07:41:21.574 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset foo1,foo2,foo3 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo1 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo2 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo3 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset foo1,foo4,foo5 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo4 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo5 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo1 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset foo6,foo7 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo7 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: foo6 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns1:foo4 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns1:foo5 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns2:foo7 2024-01-23T07:41:21.575 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns2:foo6 2024-01-23T07:41:21.576 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: ns1:foo1 2024-01-23T07:41:21.576 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: :foo1 2024-01-23T07:41:21.576 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: :foo2 2024-01-23T07:41:21.576 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: :foo3 2024-01-23T07:41:21.576 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (4102 ms) 2024-01-23T07:41:32.617 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 1 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 10 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 13 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 7 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 14 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 0 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 15 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 11 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 5 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 8 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 6 0 2024-01-23T07:41:32.618 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 3 0 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 4 0 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 12 0 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 9 0 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 2 0 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (4446 ms) 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] 3 tests from LibRadosListEC (10525 ms total) 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3223 ms) 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] 1 test from LibRadosListNP (3224 ms total) 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [----------] Global test environment tear-down 2024-01-23T07:41:32.619 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [==========] 11 tests from 3 test suites ran. (399266 ms total) 2024-01-23T07:41:32.620 INFO:tasks.workunit.client.0.smithi116.stdout: api_list: [ PASSED ] 11 tests. 2024-01-23T07:41:37.979 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:26.358 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:37.983 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:26.363 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:38.005 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:26.341 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:38.010 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:26.346 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:38.037 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:26.417 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:38.041 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:26.421 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:38.044 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:26.423 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:38.059 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:26.395 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:38.100 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:26.479 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.582 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:36.961 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.588 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:36.967 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.624 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:37.003 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.658 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:36.994 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.663 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:36.999 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.673 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:37.053 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.676 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:37.056 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.697 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:37.033 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:48.709 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:37.089 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:55.419 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: Running main() from gmock_main.cc 2024-01-23T07:41:55.419 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-01-23T07:41:55.419 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [----------] Global test environment set-up. 2024-01-23T07:41:55.419 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-01-23T07:41:55.419 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-01-23T07:41:55.419 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (58121 ms) 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (65585 ms) 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (15105 ms) 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (22815 ms) 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (38126 ms) 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (20376 ms) 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (201485 ms) 2024-01-23T07:41:55.420 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (421613 ms total) 2024-01-23T07:41:55.421 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: 2024-01-23T07:41:55.421 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [----------] Global test environment tear-down 2024-01-23T07:41:55.421 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (421613 ms total) 2024-01-23T07:41:55.421 INFO:tasks.workunit.client.0.smithi116.stdout: write_operations: [ PASSED ] 7 tests. 2024-01-23T07:41:57.795 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (75824 ms) 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (11558 ms) 2024-01-23T07:41:57.796 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (56250 ms) 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (25930 ms) 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (33926 ms) 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (10160 ms) 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (210610 ms) 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (424259 ms total) 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (424259 ms total) 2024-01-23T07:41:57.797 INFO:tasks.workunit.client.0.smithi116.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-01-23T07:41:58.100 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:46.479 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.149 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:46.484 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.153 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:46.489 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.158 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:46.537 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.186 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:09:46.522 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.193 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:09:46.573 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.221 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:46.601 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.228 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:46.607 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:41:58.257 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:09:46.636 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: 2024-01-23T07:42:09.245 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: seed 40767 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (15 ms) 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (82504 ms) 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (24083 ms) 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (24245 ms) 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (1664 ms) 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (1130 ms) 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (930 ms) 2024-01-23T07:42:09.246 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (107 ms) 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (155 ms) 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (255 ms) 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (41 ms) 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (3802 ms) 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (149 ms) 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: osd_max_attr_size = 0 2024-01-23T07:42:09.247 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (196795 ms) 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (10475 ms) 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: done waiting, doing copies 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: waiting for final deep scrubs... 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: done waiting 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (78791 ms) 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (295 ms) 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (56 ms) 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-01-23T07:42:09.248 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4205 ms) 2024-01-23T07:42:09.249 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-01-23T07:42:09.249 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-01-23T07:42:09.249 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-01-23T07:42:09.249 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-01-23T07:42:09.249 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-01-23T07:42:09.249 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (1 ms) 2024-01-23T07:42:18.356 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:06.735 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.376 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:06.755 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.408 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:06.744 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.409 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:06.745 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.420 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:06.799 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.422 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:06.801 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.440 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:06.819 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.470 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:06.806 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:18.477 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:06.857 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:28.483 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [------eWrite 2024-01-23T07:42:28.483 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7797 ms) 2024-01-23T07:42:28.483 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-01-23T07:42:28.483 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7956 ms) 2024-01-23T07:42:28.483 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-01-23T07:42:28.483 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7924 ms) 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (9431 ms) 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (8912 ms) 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7271 ms) 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7924 ms) 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7932 ms) 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7088 ms) 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-01-23T07:42:28.484 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6779 ms) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7690 ms) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6963 ms) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (8825 ms) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7008 ms) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7755 ms) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7097 ms) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (124353 ms total) 2024-01-23T07:42:28.485 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: 2024-01-23T07:42:28.486 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [----------] Global test environment tear-down 2024-01-23T07:42:28.486 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (455201 ms total) 2024-01-23T07:42:28.486 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio: [ PASSED ] 42 tests. 2024-01-23T07:42:38.413 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:26.792 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.477 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:26.856 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.519 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:26.855 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.520 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:26.856 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.527 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:26.907 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.528 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:26.907 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.531 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:26.911 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.565 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:26.901 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:38.576 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:26.956 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:39.489 INFO:tasks.workunit.client.0.smithi116.stdout:----] 22 tests from LibRadosMiscPP (429699 ms total) 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (3248 ms) 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (3248 ms total) 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-01-23T07:42:39.490 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (496 ms) 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (44 ms) 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (540 ms total) 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (895 ms) 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-01-23T07:42:39.491 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (60 ms) 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (955 ms total) 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (592 ms) 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (40 ms) 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (632 ms total) 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: 2024-01-23T07:42:39.492 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-01-23T07:42:39.493 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-01-23T07:42:39.493 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1517 ms) 2024-01-23T07:42:39.493 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1517 ms total) 2024-01-23T07:42:39.493 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: 2024-01-23T07:42:39.493 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-01-23T07:42:39.493 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (466092 ms total) 2024-01-23T07:42:39.493 INFO:tasks.workunit.client.0.smithi116.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-01-23T07:42:58.512 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:46.891 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.515 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:46.894 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.556 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:10:46.936 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.567 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:46.946 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.568 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:46.948 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.576 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:46.912 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.577 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:46.913 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.609 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:10:46.945 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:42:58.610 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:10:46.989 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.450 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:06.829 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.511 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:06.890 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.554 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:06.890 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.557 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:06.893 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.561 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:06.940 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.568 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:06.948 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.569 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:06.949 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.602 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:06.938 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:18.614 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:06.993 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.737 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:27.116 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.749 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:27.129 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.792 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:27.171 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.803 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:27.139 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.804 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:27.140 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.810 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:27.190 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.811 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:27.191 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.851 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:27.187 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:38.857 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:27.237 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:41.930 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:30.309 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:41.944 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:30.324 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:41.946 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:30.326 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:41.950 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:30.286 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:41.951 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:30.288 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:41.979 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:30.358 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:42.020 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:30.399 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:42.042 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:30.421 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:42.052 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:30.388 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.726 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:47.105 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.730 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:47.110 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.756 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:11:47.135 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.774 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:47.154 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.777 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:47.157 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.786 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:47.122 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.790 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:47.126 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.804 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:11:47.183 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:43:58.821 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:11:47.157 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.755 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:07.133 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.814 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:07.193 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.839 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:07.218 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.863 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:07.198 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.864 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:07.244 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.865 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:07.201 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.866 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:07.246 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.886 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:07.222 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:18.887 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:07.267 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:31.722 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:44:31.717+0000 ec4e640 -1 osd.2 448 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20527.0:238 197.5s0 197:a96ce6a2:::237:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e448) 2024-01-23T07:44:39.033 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:27.412 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.095 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:27.474 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.135 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:27.514 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.155 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:27.491 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.159 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:27.496 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.177 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:27.557 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.181 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:27.561 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.187 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:27.523 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:39.225 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:27.605 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.924 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:32.304 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.928 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:32.307 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.949 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:32.327 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.979 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:32.315 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.982 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:32.319 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.986 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:32.366 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.990 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:32.370 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:43.999 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:32.334 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:44.007 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:32.387 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:58.982 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:47.361 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:58.983 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:47.363 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.008 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:47.388 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.025 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:47.361 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.027 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:47.407 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.029 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:47.366 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.030 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:47.410 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.055 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:47.391 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.057 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:47.436 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.718 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:48.054 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.718 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:48.055 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.726 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:12:48.062 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.748 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:48.127 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.749 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:48.129 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.753 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:48.132 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.754 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:48.134 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.759 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:12:48.139 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:44:59.762 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:12:48.142 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.010 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:07.389 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.015 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:07.394 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.036 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:07.415 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.063 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:07.442 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.066 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:07.446 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.075 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:07.411 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.080 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:07.417 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.088 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:07.468 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.100 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:07.436 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.745 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:08.124 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.746 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:08.125 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.763 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:08.142 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.765 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:08.145 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.766 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:08.146 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.773 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:08.109 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.774 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:08.154 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.774 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:08.111 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:19.782 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:08.118 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:20.014 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:20.013+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:21.059 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:21.057+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:22.038 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:22.036+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:23.042 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:23.040+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:23.996 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:23.994+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:25.032 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:25.029+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:26.031 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:26.029+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:27.066 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:27.063+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:28.042 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:28.040+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:29.088 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:29.086+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:30.116 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:30.114+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:31.146 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:31.144+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:32.112 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:32.111+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:33.159 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:33.156+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:34.049 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:22.428 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.053 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:22.432 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.073 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:22.452 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.099 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:22.435 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.102 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:22.438 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.103 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:22.482 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.104 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:22.484 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.121 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:22.457 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.122 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:22.502 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:34.151 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:34.149+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:35.157 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:35.153+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:36.118 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:36.116+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:37.143 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:37.141+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:38.145 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:38.144+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:39.160 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:39.157+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:40.186 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:40.184+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:41.199 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:41.197+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:42.212 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:42.211+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:43.202 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:43.201+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:44.088 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:32.467 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.090 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:32.470 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.107 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:32.486 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.134 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:32.514 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.137 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:32.473 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.137 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:32.517 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.140 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:32.476 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.157 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:32.494 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.158 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:32.538 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:44.251 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:44.247+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:45.292 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:45.290+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:46.347 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:46.345+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:47.310 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:47.308+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:48.273 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:48.272+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:49.052 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:37.431 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.103 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:37.482 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.121 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:37.500 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.149 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:37.485 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.151 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:37.487 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.157 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:37.537 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.160 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:37.539 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.164 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:37.500 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.175 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:37.555 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:45:49.311 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:49.309+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:50.348 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:50.348+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:51.307 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:51.306+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:52.339 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:52.339+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:53.355 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:53.354+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:54.364 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:54.363+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:55.413 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:55.412+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:56.414 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:56.411+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:57.368 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:57.365+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:58.396 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:58.394+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:45:59.447 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:45:59.445+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:00.430 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:00.428+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:01.402 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:01.400+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:02.369 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:02.367+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:03.344 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:03.341+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:04.144 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:52.523 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.146 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:52.526 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.164 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:52.544 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.192 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:52.528 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.193 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:52.572 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.193 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:52.529 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.195 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:52.575 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.214 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:52.550 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.218 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:52.597 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.360 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:04.358+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:04.907 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:53.243 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.909 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:53.245 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.919 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:13:53.255 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.942 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:53.322 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.943 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:53.322 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.943 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:53.323 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.944 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:53.323 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.952 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:13:53.331 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:04.953 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:13:53.332 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:05.338 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:05.336+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:06.374 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:06.371+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:07.348 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:07.342+0000 ec4e640 -1 osd.2 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:44.449048+0000 front 2024-01-23T07:44:44.445898+0000 (oldest deadline 2024-01-23T07:46:07.320590+0000) 2024-01-23T07:46:07.349 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:07.347+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:08.179 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:46:08.174+0000 12c56640 -1 osd.1 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:41.770187+0000 front 2024-01-23T07:44:41.762294+0000 (oldest deadline 2024-01-23T07:46:07.655831+0000) 2024-01-23T07:46:08.211 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:46:08.207+0000 ec4e640 -1 osd.0 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:46.027860+0000 front 2024-01-23T07:44:46.020295+0000 (oldest deadline 2024-01-23T07:46:07.782317+0000) 2024-01-23T07:46:08.295 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:46:08.289+0000 ec4e640 -1 osd.5 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:45.039886+0000 front 2024-01-23T07:44:45.055033+0000 (oldest deadline 2024-01-23T07:46:07.964457+0000) 2024-01-23T07:46:08.367 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:08.366+0000 ec4e640 -1 osd.2 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:44.449048+0000 front 2024-01-23T07:44:44.445898+0000 (oldest deadline 2024-01-23T07:46:07.320590+0000) 2024-01-23T07:46:08.373 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:08.371+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:09.130 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:46:09.129+0000 12c56640 -1 osd.1 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:41.770187+0000 front 2024-01-23T07:44:41.762294+0000 (oldest deadline 2024-01-23T07:46:07.655831+0000) 2024-01-23T07:46:09.245 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:46:09.238+0000 ec4e640 -1 osd.0 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:46.027860+0000 front 2024-01-23T07:44:46.020295+0000 (oldest deadline 2024-01-23T07:46:07.782317+0000) 2024-01-23T07:46:09.341 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T07:46:09.334+0000 ec4e640 -1 osd.5 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:45.039886+0000 front 2024-01-23T07:44:45.055033+0000 (oldest deadline 2024-01-23T07:46:07.964457+0000) 2024-01-23T07:46:09.362 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:09.359+0000 ec4e640 -1 osd.2 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:44.449048+0000 front 2024-01-23T07:44:44.445898+0000 (oldest deadline 2024-01-23T07:46:07.320590+0000) 2024-01-23T07:46:09.363 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:09.361+0000 ec4e640 -1 osd.2 468 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:09.674 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:46:09.672+0000 12c56640 -1 osd.4 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:43.737022+0000 front 2024-01-23T07:44:43.737719+0000 (oldest deadline 2024-01-23T07:46:09.028734+0000) 2024-01-23T07:46:09.864 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:46:09.860+0000 ec4e640 -1 osd.6 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:43.686493+0000 front 2024-01-23T07:44:43.689001+0000 (oldest deadline 2024-01-23T07:46:09.581225+0000) 2024-01-23T07:46:10.022 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T07:46:10.015+0000 12c56640 -1 osd.3 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:44.298997+0000 front 2024-01-23T07:44:44.299673+0000 (oldest deadline 2024-01-23T07:46:09.588533+0000) 2024-01-23T07:46:10.117 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T07:46:10.116+0000 12c56640 -1 osd.1 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:41.770187+0000 front 2024-01-23T07:44:41.762294+0000 (oldest deadline 2024-01-23T07:46:07.655831+0000) 2024-01-23T07:46:10.291 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T07:46:10.290+0000 ec4e640 -1 osd.0 468 heartbeat_check: no reply from 172.21.15.173:6828 osd.7 since back 2024-01-23T07:44:46.027860+0000 front 2024-01-23T07:44:46.020295+0000 (oldest deadline 2024-01-23T07:46:07.782317+0000) 2024-01-23T07:46:10.647 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:46:10.644+0000 ec4e640 -1 osd.2 469 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.19801.0:2111 106.2 106:42b236e6:test-rados-api-smithi116-40802-28::foo:head [writefull 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e467) 2024-01-23T07:46:11.765 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T07:46:11.745+0000 ec4e640 -1 osd.7 464 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.20527.0:461 197.0s0 197:1608f257:::460:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e464) 2024-01-23T07:46:13.748 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T07:46:13.747+0000 10451640 -1 osd.7 472 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-23T07:46:19.291 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:07.670 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.345 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:07.681 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.346 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:07.683 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.373 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:07.752 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.402 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:07.781 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.409 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:07.745 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.419 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:07.798 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.446 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:07.825 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:19.501 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:07.881 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: Running main() from gmock_main.cc 2024-01-23T07:46:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-01-23T07:46:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [----------] Global test environment set-up. 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (503341 ms) 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (8812 ms) 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (178161 ms) 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [----------] 3 tests from NeoradosECList (690314 ms total) 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [----------] Global test environment tear-down 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (690314 ms total) 2024-01-23T07:46:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: ec_list: [ PASSED ] 3 tests. 2024-01-23T07:46:24.240 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:12.619 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.243 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:12.623 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.271 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:12.651 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.273 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:12.652 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.310 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:12.646 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.314 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:12.694 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.318 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:12.654 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.344 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:12.724 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:24.345 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:12.681 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.463 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:22.842 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.468 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:22.848 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.473 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:22.809 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.476 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:22.812 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.512 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:22.891 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.514 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:22.851 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.534 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:22.913 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.535 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:22.915 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:34.578 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:22.957 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:43.849 INFO:tasks.workunit.client.0.smithi116.stdout: misc: Running main() from gmock_main.cc 2024-01-23T07:46:43.849 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-01-23T07:46:43.849 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [----------] Global test environment set-up. 2024-01-23T07:46:43.850 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-01-23T07:46:43.850 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-01-23T07:46:43.850 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.Version (6588 ms) 2024-01-23T07:46:43.850 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-01-23T07:46:43.850 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (3706 ms) 2024-01-23T07:46:43.850 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-01-23T07:46:43.851 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.LongName (668326 ms) 2024-01-23T07:46:43.851 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-01-23T07:46:43.851 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (6596 ms) 2024-01-23T07:46:43.851 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-01-23T07:46:43.851 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (2896 ms) 2024-01-23T07:46:43.851 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-01-23T07:46:43.851 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (4276 ms) 2024-01-23T07:46:43.852 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-01-23T07:46:43.852 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.Exec (3078 ms) 2024-01-23T07:46:43.852 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-01-23T07:46:43.852 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3479 ms) 2024-01-23T07:46:43.852 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-01-23T07:46:43.852 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (2839 ms) 2024-01-23T07:46:43.853 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-01-23T07:46:43.853 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3324 ms) 2024-01-23T07:46:43.853 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-01-23T07:46:43.853 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (1523 ms) 2024-01-23T07:46:43.854 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-01-23T07:46:43.854 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3422 ms) 2024-01-23T07:46:43.854 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [----------] 12 tests from NeoRadosMisc (710053 ms total) 2024-01-23T07:46:43.854 INFO:tasks.workunit.client.0.smithi116.stdout: misc: 2024-01-23T07:46:43.854 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [----------] Global test environment tear-down 2024-01-23T07:46:43.855 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [==========] 12 tests from 1 test suite ran. (710053 ms total) 2024-01-23T07:46:43.855 INFO:tasks.workunit.client.0.smithi116.stdout: misc: [ PASSED ] 12 tests. 2024-01-23T07:46:44.382 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:32.761 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.387 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:32.766 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.420 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:32.799 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.432 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:32.768 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.435 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:32.771 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.436 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:32.816 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.442 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:32.822 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.461 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:32.797 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:46:44.474 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:32.853 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.443 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:52.822 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.446 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:52.825 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.467 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:52.846 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.493 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:52.873 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.498 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:52.878 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.500 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:52.836 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.504 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:52.840 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.519 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:52.899 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:04.526 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:52.862 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.505 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:57.884 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.565 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:57.945 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.586 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:14:57.965 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.614 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:57.951 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.616 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:57.952 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.619 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:57.998 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.620 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:58.000 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.630 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:14:57.966 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:09.640 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:14:58.019 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.529 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:12.909 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.530 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:12.910 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.563 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:12.943 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.581 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:12.917 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.581 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:12.961 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.582 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:12.918 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.583 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:12.963 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.616 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:12.952 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:24.621 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:13.000 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.363 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:13.699 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.363 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:13.700 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.372 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:13.708 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.396 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:13.776 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.397 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:13.777 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.397 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:13.777 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.398 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:13.778 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.407 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:13.787 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:25.408 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:13.787 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.592 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:27.971 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.593 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:27.973 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.621 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:28.001 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.634 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:27.970 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.637 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:27.973 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.637 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:28.017 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.642 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:28.021 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.665 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:28.001 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:39.671 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:28.050 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.601 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:32.980 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.603 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:32.983 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.620 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:32.999 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.647 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:32.983 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.650 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:32.986 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.652 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:33.032 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.655 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:33.034 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.667 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:33.003 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:44.669 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:33.049 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.669 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:43.048 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.670 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:43.050 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.703 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:43.082 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.715 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:43.051 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.718 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:43.054 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.729 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:43.108 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.730 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:43.110 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.742 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:43.078 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:47:54.759 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:43.139 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:04.914 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:53.293 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:04.920 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:53.299 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:04.968 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:53.304 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:04.969 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:53.349 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:04.979 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:53.359 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:04.988 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:53.324 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:04.997 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:53.376 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:05.011 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:53.347 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:05.021 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:53.401 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.279 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: seed 40802 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (58436 ms) 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (122330 ms) 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (319 ms) 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (181085 ms total) 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: 2024-01-23T07:48:09.280 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (50570 ms) 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (54857 ms) 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (20528 ms) 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: my_snaps [3] 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: my_snaps [4,3] 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: my_snaps [5,4,3] 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: promoting some heads 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: promoting from clones for snap 6 2024-01-23T07:48:09.281 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: promoting from clones for snap 5 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: promoting from clones for snap 4 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: promoting from clones for snap 3 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: waiting for scrubs... 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: done waiting 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (149822 ms) 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (12819 ms) 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (11345 ms) 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (10408 ms) 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (11161 ms) 2024-01-23T07:48:09.282 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (55370 ms) 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (11324 ms) 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (96551 ms) 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (45388 ms) 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (9454 ms) 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (11328 ms) 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-01-23T07:48:09.283 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (16868 ms) 2024-01-23T07:48:09.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-01-23T07:48:09.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (9581 ms) 2024-01-23T07:48:09.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-01-23T07:48:09.284 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (12545 ms) 2024-01-23T07:48:09.864 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:58.244 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.924 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:58.260 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.925 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:58.304 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.932 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:58.268 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.957 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:15:58.293 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.966 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:15:58.346 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.994 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:58.374 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:09.999 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:58.378 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:10.026 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:15:58.406 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.748 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:10.127 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.952 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:10.129 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.953 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:10.095 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.953 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:10.099 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.953 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:10.194 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.953 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:10.138 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.954 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:10.191 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.954 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:10.225 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:21.954 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:10.260 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.861 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:13.240 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.866 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:13.245 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.882 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:13.262 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.926 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:13.262 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.928 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:13.265 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.931 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:13.311 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.934 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:13.314 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.942 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:13.278 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:24.946 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:13.326 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.730 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:14.066 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.731 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:14.067 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.743 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:14.080 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.773 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:14.152 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.774 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:14.153 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.789 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:14.169 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.790 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:14.170 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.801 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:14.181 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:25.805 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:14.184 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: hmm, no HitSet yet 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: ok, hit_set contains 217:602f83fe:::foo:head 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9113 ms) 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg_num = 32 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 0 ls 1705996106,0 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 1 ls 1705996106,0 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 2 ls 1705996106,0 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 3 ls 1705996106,0 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 4 ls 1705996106,0 2024-01-23T07:48:31.438 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 5 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 6 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 7 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 8 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 9 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 10 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 11 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 12 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 13 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 14 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 15 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 16 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 17 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 18 ls 1705996106,0 2024-01-23T07:48:31.439 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 19 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 20 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 21 ls 1705996107,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 22 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 23 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 24 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 25 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 26 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 27 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 28 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 29 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 30 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg 31 ls 1705996106,0 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: pg_num = 32 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6cac518f:::0:head 2024-01-23T07:48:31.440 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:02547ec2:::1:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f905c69b:::2:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:cfc208b3:::3:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d83876eb:::4:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b29083e3:::5:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c4fdafeb:::6:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:5c6b0b28:::7:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:bd63b0f1:::8:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:e960b815:::9:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:52ea6a34:::10:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:89d3ae78:::11:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:de5d7c5f:::12:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:566253c9:::13:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:62a1935d:::14:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:863748b0:::15:head 2024-01-23T07:48:31.441 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:3958e169:::16:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:4d4dabf9:::17:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:8391935d:::18:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:28883081:::19:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:69259c59:::20:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:4bdb80b7:::21:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a11c5d71:::22:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:271af37b:::23:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:95b121be:::24:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:58d1031b:::25:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:0a050783:::26:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c709704c:::27:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:cbe56eaf:::28:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:86b4b162:::29:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:70d89383:::30:head 2024-01-23T07:48:31.442 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:dd450c7c:::31:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6d5729b1:::32:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c388f3fb:::33:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:56cfea31:::34:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:9dbc1bf7:::35:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:40b74ccd:::36:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:4d5aaf42:::37:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:920f362c:::38:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6cc53222:::39:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:9cad833f:::40:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:1ea84d41:::41:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c4480ef6:::42:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a694361e:::43:head 2024-01-23T07:48:31.443 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d1bd33e9:::44:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:ddc2cd5d:::45:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:2b782207:::46:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:7b187fca:::47:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:90ecdf6f:::48:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a5ed95fe:::49:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:ea0eaa55:::50:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f33ef17b:::51:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a0d1b2f6:::52:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:60c5229e:::53:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:edcbc575:::54:head 2024-01-23T07:48:31.444 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:102cf253:::55:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:efb7fb0b:::56:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:50d0a326:::57:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d4dc5daf:::58:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:3a130462:::59:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:ec87ed71:::60:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d5bc9454:::61:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:3ddfe313:::62:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:7c2816b9:::63:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:47e00e4d:::64:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c6410c18:::65:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b48ed237:::66:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:cd63ad31:::67:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b179e92b:::68:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:0d9f741a:::69:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6d3352ae:::70:head 2024-01-23T07:48:31.445 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c6d5c19e:::71:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:bc4729c3:::72:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:77e930b9:::73:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:0abeecfd:::74:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b7c37e15:::75:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b6378398:::76:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:02bd68de:::77:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:cc795d2d:::78:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:630d4fea:::79:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:e0d29ef5:::80:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:fd6f13d2:::81:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:606461d5:::82:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:eadbdc43:::83:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:8761d0bb:::84:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:9ef0186f:::85:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:e0d41294:::86:head 2024-01-23T07:48:31.446 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:961de695:::87:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:1423148f:::88:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:633a8fa2:::89:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a8653809:::90:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:3dac8b33:::91:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:35aad435:::92:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f6dcc343:::93:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:dbbdad87:::94:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:1cb48ce0:::95:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:03cd461c:::96:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:17a4ea99:::97:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:9993c9a7:::98:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6394211c:::99:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:94c7ae57:::100:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6fdee5bb:::101:head 2024-01-23T07:48:31.447 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:9a477fd1:::102:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:eb850916:::103:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:affc56b9:::104:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b42dc814:::105:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f319f8f0:::106:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:9a40b9de:::107:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:8b524f28:::108:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:e3de589f:::109:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:90f90a5b:::110:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a7b4f1d7:::111:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:af51766e:::112:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b6f90bd1:::113:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:e0261208:::114:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c9569ef7:::115:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:61bebe50:::116:head 2024-01-23T07:48:31.448 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:fe93412b:::117:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d3d38bee:::118:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:3100ba0c:::119:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d0560ada:::120:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f0ea8b35:::121:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:766f231a:::122:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a07a2582:::123:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:bd7c6b3a:::124:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:fb2ddaff:::125:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:4408e1fe:::126:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:ee1df7a7:::127:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c3002909:::128:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:4f48ffa9:::129:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:edf38733:::130:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c08425c0:::131:head 2024-01-23T07:48:31.449 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:5f902d98:::132:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:41ea2c93:::133:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:813cee13:::134:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:0131818d:::135:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:26ba5a85:::136:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:381b8a5a:::137:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:28797e47:::138:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:bfca7f22:::139:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:36807075:::140:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:80b03975:::141:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:5c15709b:::142:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f39ea15e:::143:head 2024-01-23T07:48:31.450 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:ea992956:::144:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:48887b1c:::145:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:9f24a9dd:::146:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:987f100b:::147:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d2dd3581:::148:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:7fed1808:::149:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c80b70e9:::150:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:85ed90f9:::151:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:36428b24:::152:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d044c34a:::153:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:7c18bf58:::154:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d1c21232:::155:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a7a3c575:::156:head 2024-01-23T07:48:31.451 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:87da0633:::157:head 2024-01-23T07:48:31.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d5ac3822:::158:head 2024-01-23T07:48:31.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:3f20522d:::159:head 2024-01-23T07:48:31.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6ca26563:::160:head 2024-01-23T07:48:31.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:532ce135:::161:head 2024-01-23T07:48:31.452 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:c78863e6:::162:head 2024-01-23T07:48:40.024 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:28.403 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.026 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:28.406 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.048 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:28.428 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.071 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:28.451 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.075 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:28.454 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.076 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:28.412 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.077 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:28.414 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.098 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:28.434 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:40.099 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:28.479 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:44.965 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:33.344 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:44.968 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:33.348 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:44.985 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:33.365 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:45.019 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:33.399 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:45.023 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:33.403 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:45.027 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:33.363 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:45.030 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:33.367 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:45.044 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:33.423 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:48:45.048 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:33.385 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.018 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:48.396 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.035 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:48.414 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.061 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:48.441 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.066 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:48.402 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.071 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:48.407 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.078 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:48.458 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.080 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:48.459 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.093 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:48.429 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:00.103 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:48.483 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.173 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:53.552 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.250 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:53.629 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.266 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:16:53.646 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.301 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:53.637 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.304 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:53.684 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.305 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:53.642 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.308 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:53.688 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.322 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:16:53.659 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:05.326 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:16:53.706 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.204 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:03.583 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.208 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:03.587 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.234 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:03.613 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.255 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:03.591 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.259 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:03.595 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.272 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:03.652 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.273 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:03.653 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.288 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:03.624 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:15.301 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:03.681 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.125 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:13.505 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.127 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:13.506 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.165 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:13.544 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.168 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:13.504 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.171 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:13.508 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.195 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:13.531 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.197 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:13.577 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.201 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:13.581 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:25.230 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:13.610 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.094 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:18.473 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.148 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:18.528 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.164 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:18.543 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.195 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:18.531 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.198 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:18.534 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.202 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:18.581 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.205 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:18.585 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.210 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:18.546 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:30.218 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:18.598 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:41.212 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:7462ddf6:::163:head 2024-01-23T07:49:41.212 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:5d165639:::164:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f43765fc:::165:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b4c720e9:::166:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:e694b040:::167:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:afa38db2:::168:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:77ba9f53:::169:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:87495034:::170:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:7c96bf0e:::171:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:dbe346cc:::172:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:e943ec24:::173:head 2024-01-23T07:49:41.213 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f97a9c0c:::174:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:6f26e74d:::175:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:4f95e106:::176:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:0e6f2f8f:::177:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:05db05f1:::178:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:38a78d66:::179:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:d095610b:::180:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:a1a9d709:::181:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:1e5d39db:::182:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:f7df4fb9:::183:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:03a7f161:::184:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:ba70721e:::185:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:28e5662d:::186:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:973d52de:::187:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:4303eb1c:::188:head 2024-01-23T07:49:41.214 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:b990b48e:::189:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:29b8165b:::190:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:3547f197:::191:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:7e260936:::192:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:1abec7b1:::193:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:10fdda93:::194:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:15817eea:::195:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:770bab57:::196:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:ed9e13e7:::197:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:71471a8f:::198:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: checking for 218:10fb1d02:::199:head 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (22812 ms) 2024-01-23T07:49:41.215 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: first is 1705996130 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,1705996135,1705996136,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,1705996135,1705996136,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,1705996135,1705996136,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,1705996135,1705996136,1705996138,1705996139,0 2024-01-23T07:49:41.216 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,1705996135,1705996136,1705996138,1705996139,0 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996130,1705996132,1705996133,1705996135,1705996136,1705996138,1705996139,0 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996133,1705996135,1705996136,1705996138,1705996139,1705996141,1705996142,0 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: first now 1705996133, trimmed 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (22175 ms) 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: foo0 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (15840 ms) 2024-01-23T07:49:41.217 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-01-23T07:49:45.144 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:33.523 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.190 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:33.526 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.191 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:33.528 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.203 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:33.582 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.218 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:33.554 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.232 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:33.612 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.254 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:33.634 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.257 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:33.636 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:45.281 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:33.660 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.035 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:34.371 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.036 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:34.373 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.046 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:34.382 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.194 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:34.574 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.195 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:34.575 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.199 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:34.578 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.201 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:34.580 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.209 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:34.588 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:49:46.214 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:34.593 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.241 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:48.620 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.245 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:48.625 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.274 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:48.653 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.293 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:48.629 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.295 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:48.631 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.303 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:48.682 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.305 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:48.685 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.320 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:48.656 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:00.340 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:48.720 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.387 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:53.723 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.388 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:53.724 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.389 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:53.769 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.390 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:53.769 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.392 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:53.771 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.392 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:53.772 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.402 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:17:53.739 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.408 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:17:53.788 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:05.409 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:17:53.789 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.454 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:03.833 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.459 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:03.839 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.489 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:03.868 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.525 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:03.861 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.531 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:03.867 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.533 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:03.913 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.543 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:03.922 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.567 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:03.904 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:15.578 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:03.958 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.407 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:13.786 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.409 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:13.789 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.450 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:13.829 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.474 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:13.853 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.478 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:13.857 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.480 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:13.817 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.486 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:13.822 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.515 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:13.851 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:25.517 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:13.897 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.237 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:16.616 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.286 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:16.665 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.303 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:16.682 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.339 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:16.675 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.339 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:16.719 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.341 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:16.677 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.345 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:16.725 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.361 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:16.697 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:28.364 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:16.744 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.498 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:23.877 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.557 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:23.893 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.559 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:23.895 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.579 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:23.959 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.581 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:23.960 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.586 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:23.923 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.587 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:23.967 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.611 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:23.991 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:35.712 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:24.092 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.511 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:33.890 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.568 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:33.947 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.593 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:33.973 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.614 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:33.950 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.615 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:33.952 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.620 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:33.999 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.622 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:34.002 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.637 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:33.973 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:45.644 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:34.023 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.513 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:38.892 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.562 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:38.941 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.579 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:38.959 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.611 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:38.948 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.613 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:38.949 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.624 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:38.961 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.627 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:39.006 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.633 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:39.013 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:50:50.643 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:39.023 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.539 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:53.918 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.543 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:53.923 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.563 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:53.943 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.587 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:53.923 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.587 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:53.967 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.591 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:53.928 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.592 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:53.972 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.611 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:53.947 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:05.614 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:53.994 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.704 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:59.083 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.707 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:59.087 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.718 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:18:59.097 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.753 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:59.089 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.756 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:59.092 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.757 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:59.137 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.759 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:59.139 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.767 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:18:59.103 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:10.770 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:18:59.150 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.801 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:14.180 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.803 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:14.183 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.834 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:14.214 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.851 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:14.187 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.853 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:14.233 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.854 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:14.191 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.857 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:14.237 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.881 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:14.217 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:25.884 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:14.263 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.769 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:34.149 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.772 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:34.152 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.824 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:34.203 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.826 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:34.206 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.833 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:34.169 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.833 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:34.213 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.835 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:34.171 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.879 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:34.215 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:45.886 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:34.266 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:46.771 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:35.107 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:46.772 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:35.108 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:46.781 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:35.117 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:46.914 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:35.294 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:46.915 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:35.295 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:46.925 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:35.305 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:47.026 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:35.405 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:47.027 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:35.406 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:51:47.036 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:35.415 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.771 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:54.151 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.775 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:54.155 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.804 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:54.183 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.822 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:54.158 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.824 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:54.160 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.827 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:54.207 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.832 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:54.212 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.843 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:54.179 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:05.858 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:54.238 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.528 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:54.864 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.529 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:54.866 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.537 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:19:54.874 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.576 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:54.956 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.577 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:54.957 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.591 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:19:54.971 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.594 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:54.974 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.595 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:54.975 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:06.603 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:19:54.983 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.823 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:09.203 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.827 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:09.206 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.877 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:09.256 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.879 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:09.215 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.880 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:09.260 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.881 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:09.217 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.882 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:09.262 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.904 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:09.240 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:20.908 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:09.287 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.830 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:14.209 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.834 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:14.213 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.850 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:14.230 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.880 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:14.217 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.882 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:14.219 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.887 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:14.266 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.891 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:14.270 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.893 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:14.230 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:25.902 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:14.282 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.891 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:24.270 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.894 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:24.274 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.920 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:24.300 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.942 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:24.322 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.943 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:24.280 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.945 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:24.325 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.945 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:24.282 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.967 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:24.303 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:35.968 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:24.348 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:45.928 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:34.307 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:45.932 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:34.312 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:45.959 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:34.339 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:45.975 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:34.311 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:45.977 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:34.313 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:45.988 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:34.368 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:45.991 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:34.371 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:46.001 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:34.338 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:46.028 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:34.408 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.870 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:38.249 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.876 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:38.256 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.891 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:38.271 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.926 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:38.306 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.927 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:38.263 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.928 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:38.264 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.929 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:38.309 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.943 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:38.279 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:49.945 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:38.325 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.050 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:39.430 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.054 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:39.433 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.064 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:39.443 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.104 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:39.440 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.107 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:39.443 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.113 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:39.493 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.117 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:39.496 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.118 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:39.455 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:52:51.130 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:39.510 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:05.983 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:54.362 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:05.987 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:54.367 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:06.004 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:54.384 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:06.034 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:54.371 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:06.037 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:54.416 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:06.037 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:54.373 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:06.038 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:54.418 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:06.053 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:54.389 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:06.055 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:54.434 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:07.453 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T07:53:07.440+0000 2287b640 -1 snap_mapper.add_oid found existing snaps mapped on 236:59f353e2:test-rados-api-smithi116-40802-80::foo:2, removing 2024-01-23T07:53:07.461 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T07:53:07.455+0000 29889640 -1 snap_mapper.add_oid found existing snaps mapped on 236:59f353e2:test-rados-api-smithi116-40802-80::foo:2, removing 2024-01-23T07:53:11.352 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:59.731 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.354 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:59.734 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.384 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:20:59.763 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.417 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:59.753 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.427 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:59.763 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.450 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:20:59.786 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.504 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:59.883 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.519 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:59.899 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:11.542 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:20:59.922 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.067 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:14.446 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.071 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:14.450 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.107 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:14.486 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.118 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:14.455 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.120 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:14.457 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.123 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:14.503 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.124 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:14.504 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.153 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:14.489 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:26.158 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:14.538 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.044 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:15.380 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.045 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:15.382 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.057 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:15.393 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.090 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:15.469 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.091 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:15.471 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.100 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:15.480 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.158 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:15.537 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.159 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:15.538 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:27.168 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:15.548 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:44.412 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ProxyRead (21993 ms) 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (26361 ms) 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (5509 ms) 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (5476 ms) 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (4362 ms) 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-01-23T07:53:44.413 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (5278 ms) 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (5596 ms) 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (40377 ms) 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (18708 ms) 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (5536 ms) 2024-01-23T07:53:44.414 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (4724 ms) 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (28039 ms) 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (16951 ms) 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (8386 ms) 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (5516 ms) 2024-01-23T07:53:44.415 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: waiting for scrubs... 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: done waiting 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (26291 ms) 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (14026 ms) 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (11108 ms) 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:53:44.416 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (10956 ms) 2024-01-23T07:53:46.124 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:34.503 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.127 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:34.507 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.172 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:34.551 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.176 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:34.512 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.177 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:34.514 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.178 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:34.558 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.181 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:34.561 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.215 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:34.551 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:46.222 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:34.602 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.166 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:35.503 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.168 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:35.504 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.179 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:35.516 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.453 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:35.833 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.454 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:35.834 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.463 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:35.843 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.488 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:35.867 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.489 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:35.868 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:47.499 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:35.878 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.455 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:44.834 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.463 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:44.843 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.522 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:44.901 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.534 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:44.870 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.535 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:44.872 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.541 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:44.920 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.544 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:44.924 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.570 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:44.907 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:53:56.585 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:44.965 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.600 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:54.977 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.624 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:55.004 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.662 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:54.998 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.665 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:21:55.045 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.669 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:55.005 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.680 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:55.059 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.685 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:55.065 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.697 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:21:55.034 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:06.819 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:21:55.198 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.536 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:09.916 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.538 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:09.917 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.567 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:09.946 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.585 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:09.964 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.585 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:09.921 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.587 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:09.923 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.590 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:09.970 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.618 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:09.955 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:21.622 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:10.002 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.667 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:15.047 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.672 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:15.051 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.699 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:15.078 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.719 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:15.099 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.720 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:15.100 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.732 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:15.112 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.745 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:15.082 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.747 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:15.083 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:26.758 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:15.095 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.751 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:30.130 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.753 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:30.133 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.790 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:30.169 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.802 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:30.138 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.804 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:30.140 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.812 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:30.192 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.817 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:30.197 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.830 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:30.166 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:41.840 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:30.220 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.653 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:35.032 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.656 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:35.035 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.666 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:35.046 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.703 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:35.039 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.705 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:35.085 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.705 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:35.041 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.706 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:35.086 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.714 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:35.051 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:46.720 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:35.100 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:52.466 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T07:54:52.459+0000 2c08e640 -1 snap_mapper.add_oid found existing snaps mapped on 106:e0ed023c:test-rados-api-smithi116-40802-97::foo:21, removing 2024-01-23T07:54:52.474 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T07:54:52.441+0000 2287b640 -1 snap_mapper.add_oid found existing snaps mapped on 106:e0ed023c:test-rados-api-smithi116-40802-97::foo:21, removing 2024-01-23T07:54:56.963 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:45.342 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:56.970 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:45.350 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:56.989 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:45.369 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:57.021 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:45.358 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:57.024 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:45.360 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:57.044 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:45.380 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:57.045 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:45.425 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:57.048 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:45.428 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:54:57.067 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:45.446 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.907 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:55.286 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.908 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:55.288 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.951 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:22:55.331 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.957 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:55.293 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.959 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:55.296 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.963 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:55.343 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.966 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:55.346 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:06.991 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:22:55.325 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:07.002 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:22:55.381 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.809 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:00.189 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.814 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:00.194 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.838 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:00.218 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.861 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:00.197 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.864 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:00.200 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.878 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:00.215 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.890 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:00.270 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.892 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:00.272 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:11.910 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:00.290 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.887 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:15.266 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.915 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:15.295 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.936 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:15.316 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.939 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:15.319 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.944 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:15.281 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.947 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:15.284 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.953 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:15.332 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.977 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:15.357 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:26.983 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:15.319 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.723 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:16.059 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.724 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:16.060 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.734 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:16.070 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.833 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:16.213 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.834 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:16.214 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.852 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:16.231 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.857 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:16.237 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.858 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:16.238 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:27.877 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:16.256 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.120 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:35.498 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.122 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:35.501 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.126 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:35.505 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.180 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:35.516 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.185 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:35.518 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.193 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:35.573 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.207 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:35.587 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.242 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:35.578 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:55:47.245 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:35.625 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.105 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:50.484 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.111 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:50.491 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.146 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:50.525 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.163 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:50.543 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.166 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:50.545 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.167 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:50.503 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.171 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:50.507 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.199 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:50.578 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:02.206 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:50.543 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.022 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:55.401 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.023 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:55.403 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.038 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:23:55.418 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.065 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:55.401 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.069 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:55.405 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.073 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:55.452 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.075 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:55.455 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.085 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:23:55.421 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:07.096 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:23:55.476 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.087 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:05.466 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.091 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:05.471 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.119 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:05.498 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.138 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:05.474 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.139 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:05.476 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.141 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:05.520 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.147 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:05.527 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.168 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:05.504 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:17.178 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:05.558 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.199 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:15.578 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.202 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:15.582 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.228 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:15.608 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.246 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:15.582 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.247 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:15.583 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.251 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:15.631 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.253 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:15.632 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.272 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:15.609 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:27.280 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:15.659 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.168 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:25.547 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.214 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:25.550 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.217 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:25.553 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.227 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:25.606 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.239 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:25.575 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.262 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:25.642 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.298 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:25.678 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.299 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:25.679 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:37.323 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:25.703 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.245 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:35.624 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.249 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:35.629 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.271 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:35.651 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.295 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:35.631 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.297 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:35.633 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.299 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:35.678 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.300 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:35.680 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.313 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:35.649 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:47.318 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:35.698 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.406 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:45.786 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.412 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:45.791 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.435 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:45.815 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.455 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:45.834 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.458 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:45.838 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.460 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:45.797 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.462 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:45.798 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.476 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:45.856 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:56:57.480 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:45.816 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.805 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:55.185 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.809 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:55.189 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.841 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:24:55.220 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.861 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:55.198 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.865 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:55.201 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.867 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:55.247 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.871 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:55.251 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.893 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:24:55.229 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:06.904 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:24:55.284 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.475 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:00.855 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.480 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:00.860 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.502 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:00.882 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.521 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:00.857 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.524 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:00.861 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.544 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:00.880 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.544 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:00.924 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.546 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:00.926 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:12.568 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:00.948 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.530 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:15.909 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.533 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:15.913 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.540 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:15.877 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.545 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:15.881 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.566 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:15.946 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.593 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:15.929 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.595 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:15.975 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.597 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:15.976 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:27.633 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:16.013 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.434 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:20.814 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.436 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:20.815 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.452 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:20.831 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.480 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:20.860 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.482 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:20.862 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.484 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:20.820 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.485 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:20.822 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.497 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:20.877 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:32.500 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:20.836 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.612 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:30.991 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.613 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:30.993 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.640 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:31.020 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.668 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:31.047 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.669 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:31.005 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.670 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:31.006 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.671 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:31.051 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.696 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:31.033 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:42.698 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:31.078 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:47.548 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-01-23T07:57:47.548 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:57:47.548 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (11339 ms) 2024-01-23T07:57:47.548 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-01-23T07:57:47.548 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (9007 ms) 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (6559 ms) 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (26671 ms) 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (15997 ms) 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (13995 ms) 2024-01-23T07:57:47.549 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: 00000010 69 73 |is| 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: 00000012 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (13925 ms) 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: require_osd_release = squid 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (7780 ms) 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (1030325 ms total) 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1396 ms) 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-01-23T07:57:47.550 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11453 ms) 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (19188 ms) 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (18 ms) 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (32055 ms total) 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (8185 ms) 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (10821 ms) 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-01-23T07:57:47.551 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: waiting for scrub... 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: done waiting 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (26123 ms) 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (11172 ms) 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8788 ms) 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (10156 ms) 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (11188 ms) 2024-01-23T07:57:47.552 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-01-23T07:57:52.610 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:40.990 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.664 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:41.000 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.667 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:41.047 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.668 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:41.005 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.697 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:41.077 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.699 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:41.035 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.744 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:41.124 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.746 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:41.126 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:52.775 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:41.155 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.564 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:45.943 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.565 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:45.945 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.581 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:25:45.961 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.608 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:45.987 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.611 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:45.991 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.613 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:45.949 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.614 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:45.951 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.624 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:25:46.004 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:57:57.625 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:25:45.961 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.851 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:01.230 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.860 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:01.240 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.914 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:01.250 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.932 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:01.268 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.937 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:01.317 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.946 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:01.326 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.987 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:01.323 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:12.988 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:01.368 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:13.022 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:01.402 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.695 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:16.075 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.700 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:16.079 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.702 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:16.082 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.740 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:16.119 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.747 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:16.083 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.751 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:16.087 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.763 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:16.143 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.784 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:16.121 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:27.808 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:16.188 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.809 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:21.188 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.810 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:21.190 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.837 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:21.217 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.860 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:21.240 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.863 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:21.243 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.864 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:21.201 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.869 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:21.205 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.889 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:21.269 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:32.894 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:21.230 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.769 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:31.149 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.772 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:31.151 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.801 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:31.181 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.814 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:31.150 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.817 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:31.153 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.819 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:31.199 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.822 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:31.202 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.841 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:31.177 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:42.855 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:31.234 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.807 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:41.186 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.809 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:41.189 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.846 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:41.225 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.850 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:41.186 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.853 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:41.189 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.869 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:41.249 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.872 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:41.252 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.877 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:41.213 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:52.906 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:41.286 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:57.905 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:46.284 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:57.910 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:46.289 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:57.928 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:46.308 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:57.970 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:46.350 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:57.976 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:46.313 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:57.979 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:46.358 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:57.979 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:46.316 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:58.007 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:46.344 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:58:58.010 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:46.390 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.021 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:51.400 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.026 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:51.406 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.058 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:26:51.437 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.079 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:51.416 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.082 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:51.418 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.095 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:51.475 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.097 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:51.477 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.101 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:26:51.437 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:03.127 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:26:51.506 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.922 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:01.301 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.924 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:01.304 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.943 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:01.322 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.973 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:01.352 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.975 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:01.355 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.981 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:01.317 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.984 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:01.320 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:12.990 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:01.370 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.003 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:01.339 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.638 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:01.973 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.638 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:01.974 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.646 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:01.982 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.687 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:02.066 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.688 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:02.067 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.689 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:02.068 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.690 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:02.070 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.697 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:02.077 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:13.702 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:02.081 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:27.982 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:16.361 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:27.986 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:16.365 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:28.019 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:16.398 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:28.033 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:16.369 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:28.036 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:16.372 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:28.044 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:16.424 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:28.045 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:16.425 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:28.065 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:16.402 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:28.075 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:16.455 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.138 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:21.518 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.141 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:21.521 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.162 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:21.541 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.197 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:21.577 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.199 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:21.579 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.204 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:21.540 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.205 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:21.542 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.221 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:21.557 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:33.224 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:21.603 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.055 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:31.434 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.059 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:31.439 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.087 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:31.467 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.109 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:31.488 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.111 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:31.491 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.118 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:31.454 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.119 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:31.455 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.137 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:31.517 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:43.145 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:31.481 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.081 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:41.460 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.083 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:41.462 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.101 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:41.480 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.127 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:41.463 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.128 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:41.464 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.130 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:41.509 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.133 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:41.512 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.141 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:41.477 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T07:59:53.151 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:41.531 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.110 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:51.489 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.112 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:51.492 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.141 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:27:51.521 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.159 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:51.495 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.161 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:51.497 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.165 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:51.544 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.169 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:51.549 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.183 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:27:51.519 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:03.194 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:27:51.573 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.286 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:01.665 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.292 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:01.671 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.328 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:01.707 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.337 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:01.673 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.339 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:01.675 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.350 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:01.730 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.352 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:01.732 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.363 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:01.700 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:13.382 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:01.762 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.150 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:06.529 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.152 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:06.532 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.165 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:06.545 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.201 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:06.537 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.201 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:06.581 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.204 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:06.541 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.205 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:06.584 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.220 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:06.600 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:18.221 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:06.558 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.374 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:21.754 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.379 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:21.758 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.424 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:21.761 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.428 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:21.807 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.428 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:21.764 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.437 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:21.817 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.441 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:21.821 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.463 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:21.800 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:33.482 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:21.862 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.417 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:22.753 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.418 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:22.754 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.427 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:22.764 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.458 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:22.838 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.459 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:22.839 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.472 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:22.852 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.514 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:22.893 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.515 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:22.895 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:34.525 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:22.905 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:43.984 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (8892 ms) 2024-01-23T08:00:43.984 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-01-23T08:00:43.984 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (14834 ms) 2024-01-23T08:00:43.984 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (9784 ms) 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (14734 ms) 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (10409 ms) 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (9260 ms) 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-01-23T08:00:43.985 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: hmm, no HitSet yet 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: ok, hit_set contains 268:602f83fe:::foo:head 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (10061 ms) 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,0 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: first is 1705996745 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,0 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,0 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,0 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,0 2024-01-23T08:00:43.986 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,1705996751,1705996752,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,1705996751,1705996752,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,1705996751,1705996752,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,1705996751,1705996752,1705996754,1705996755,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,1705996751,1705996752,1705996754,1705996755,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996745,1705996747,1705996748,1705996751,1705996752,1705996754,1705996755,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: got ls 1705996748,1705996751,1705996752,1705996754,1705996755,1705996757,1705996758,0 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: first now 1705996748, trimmed 2024-01-23T08:00:43.987 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (22768 ms) 2024-01-23T08:00:43.988 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-01-23T08:00:43.988 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: foo0 2024-01-23T08:00:43.988 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-01-23T08:00:43.988 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (17933 ms) 2024-01-23T08:00:43.988 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-01-23T08:00:43.988 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (22145 ms) 2024-01-23T08:00:43.988 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23491 ms) 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5268 ms) 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (4336 ms) 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (4698 ms) 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3530 ms) 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (268577 ms total) 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-01-23T08:00:43.989 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (1550581 ms total) 2024-01-23T08:00:43.990 INFO:tasks.workunit.client.0.smithi116.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40494 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40494 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40650 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40650 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41183 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41183 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40882 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40882 2024-01-23T08:00:43.991 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40698 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40698 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40568 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40568 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40776 2024-01-23T08:00:43.992 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40776 2024-01-23T08:00:48.496 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:36.875 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.552 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:36.888 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.553 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:36.889 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.556 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:36.936 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.583 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:36.919 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.602 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:36.982 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.623 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:37.002 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.623 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:37.003 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:48.651 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:37.031 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.460 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:41.839 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.461 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:41.841 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.471 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:41.850 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.507 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:41.886 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.508 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:41.888 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.511 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:41.847 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.512 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:41.848 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.519 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:41.899 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:00:53.522 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:41.859 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.495 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:56.873 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.497 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:56.876 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.515 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:28:56.894 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.544 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:56.923 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.544 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:56.880 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.546 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:56.926 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.547 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:56.883 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.564 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:28:56.944 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:08.565 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:28:56.902 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.463 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:01.842 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.509 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:01.889 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.511 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:01.891 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.512 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:01.892 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.524 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:01.904 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.525 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:01.905 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.556 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:01.893 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.560 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:01.896 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:13.571 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:01.907 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.835 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:11.214 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.838 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:11.218 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.854 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:11.234 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.884 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:11.221 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.888 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:11.224 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.891 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:11.271 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.892 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:11.272 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.904 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:11.240 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:22.908 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:11.288 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.516 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:16.895 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.561 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:16.941 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.574 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:16.954 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.609 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:16.945 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.610 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:16.946 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.613 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:16.993 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.617 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:16.997 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.620 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:16.957 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:28.628 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:17.008 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.571 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:21.950 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.575 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:21.955 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.590 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:21.969 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.620 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:21.957 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.622 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:21.958 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.624 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:22.003 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.627 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:22.007 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.633 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:21.969 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:33.639 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:22.019 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.611 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:36.990 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.616 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:36.995 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.635 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:37.015 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.664 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:37.044 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.667 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:37.047 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.669 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:37.006 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.672 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:37.009 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.685 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:37.065 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:48.689 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:37.025 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.639 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:47.018 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.641 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:47.021 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.660 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:47.039 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.692 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:47.072 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.696 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:47.075 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.705 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:47.042 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.708 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:47.088 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.709 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:47.045 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:01:58.720 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:47.056 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.661 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:57.040 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.667 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:57.046 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.679 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:29:57.059 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.711 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:57.091 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.716 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:57.052 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.716 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:57.096 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.729 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:29:57.109 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.734 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:57.071 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:08.751 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:29:57.087 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.686 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:07.065 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.690 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:07.070 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.705 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:07.085 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.733 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:07.070 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.738 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:07.074 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.738 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:07.118 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.742 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:07.122 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.750 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:07.087 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:18.754 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:07.134 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.709 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:17.088 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.712 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:17.092 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.727 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:17.107 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.760 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:17.139 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.760 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:17.097 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.763 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:17.143 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.763 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:17.100 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.777 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:17.113 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:28.779 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:17.159 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.740 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:27.119 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.741 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:27.120 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.752 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:27.132 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.784 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:27.120 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.786 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:27.166 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.787 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:27.124 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.787 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:27.167 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.800 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:27.179 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:38.800 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:27.137 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.766 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:37.145 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.767 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:37.147 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.779 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:37.158 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.810 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:37.146 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.813 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:37.149 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.815 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:37.194 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.816 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:37.196 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.826 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:37.162 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:48.828 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:37.208 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.787 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:47.166 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.792 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:47.171 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.806 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:47.186 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.837 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:47.174 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.839 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:47.219 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.840 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:47.177 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.841 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:47.220 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.854 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:47.233 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:02:58.854 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:47.191 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.817 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:57.196 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.818 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:57.198 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.830 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:30:57.210 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.862 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:57.242 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.864 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:57.244 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.869 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:57.205 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.870 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:57.206 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.876 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:30:57.256 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:08.881 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:30:57.217 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.880 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:07.259 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.884 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:07.264 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.896 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:07.232 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.899 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:07.236 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.914 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:07.250 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.931 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:07.311 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.932 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:07.311 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.935 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:07.315 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:18.987 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:07.366 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.816 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:12.195 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.863 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:12.243 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.879 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:12.259 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.910 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:12.289 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.914 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:12.294 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.924 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:12.260 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.925 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:12.262 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.929 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:12.309 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:23.940 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:12.276 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.917 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:32.296 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.922 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:32.301 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.942 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:32.321 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.971 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:32.350 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.972 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:32.352 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.973 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:32.309 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.975 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:32.311 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.991 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:32.370 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:43.994 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:32.330 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.719 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:33.056 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.720 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:33.057 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.729 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:33.065 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.741 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:33.120 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.742 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:33.121 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.747 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:33.126 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.748 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:33.128 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.751 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:33.130 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:44.757 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:33.137 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.021 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:42.400 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.071 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:42.450 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.094 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:42.474 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.126 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:42.506 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.131 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:42.511 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.144 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:42.480 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.147 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:42.483 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.151 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:42.530 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:03:54.165 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:42.501 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.118 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:52.497 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.121 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:52.501 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.137 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:52.516 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.170 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:52.549 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.172 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:52.552 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.182 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:52.518 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.186 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:52.566 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.191 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:52.527 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.204 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:52.540 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.836 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:53.216 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.837 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:53.173 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.837 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:53.217 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.837 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:53.174 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.840 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:53.220 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.841 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:53.221 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.846 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:31:53.182 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.846 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:31:53.225 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:04.850 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:31:53.229 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.162 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:12.541 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.164 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:12.544 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.183 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:12.562 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.211 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:12.547 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.212 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:12.549 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.213 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:12.593 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.216 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:12.596 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.229 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:12.566 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.234 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:12.614 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.836 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:13.172 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.837 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:13.173 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.845 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:13.181 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.851 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:13.230 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.852 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:13.231 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.863 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:13.242 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.864 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:13.244 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.865 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:13.245 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:24.874 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:13.254 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.420 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:24.799 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.425 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:24.805 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.452 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:24.832 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.471 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:24.807 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.474 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:24.810 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.482 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:24.862 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.483 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:24.863 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.492 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:24.829 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:36.501 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:24.881 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.219 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:32.599 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.222 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:32.601 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.237 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:32.616 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.272 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:32.652 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.273 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:32.609 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.274 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:32.610 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.275 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:32.655 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.286 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:32.623 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.288 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:32.668 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.867 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:33.203 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.867 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:33.204 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.875 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:33.212 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.884 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:33.264 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.885 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:33.265 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.887 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:33.267 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.888 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:33.268 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.893 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:33.273 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:04:44.897 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:33.276 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.268 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:52.647 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.272 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:52.651 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.296 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:52.676 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.317 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:52.653 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.320 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:52.656 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.320 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:52.700 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.324 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:52.704 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.338 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:52.674 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.343 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:52.722 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.856 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:53.235 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.857 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:53.236 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.869 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:32:53.249 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.872 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:53.209 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.874 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:53.210 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.879 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:53.259 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.880 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:53.260 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.881 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:32:53.218 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:04.889 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:32:53.268 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: notify 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1804000 ms) 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (126 ms) 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1804126 ms total) 2024-01-23T08:05:17.609 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: notify 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (424 ms) 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: notify 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4367 ms) 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (198 ms) 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (103 ms) 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389028528 notify_id 4471060955138 notifier_gid 20575 2024-01-23T08:05:17.610 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (117 ms) 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389028528 notify_id 4471060955136 notifier_gid 20575 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (147 ms) 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389028528 notify_id 4471060955141 notifier_gid 20575 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (130 ms) 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389034064 notify_id 4471060955142 notifier_gid 20575 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (136 ms) 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389036112 notify_id 4471060955143 notifier_gid 20575 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (137 ms) 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-01-23T08:05:17.611 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389036112 notify_id 4471060955139 notifier_gid 20575 2024-01-23T08:05:17.612 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (112 ms) 2024-01-23T08:05:17.612 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-01-23T08:05:17.612 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: trying... 2024-01-23T08:05:17.612 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389036112 notify_id 4471060955140 notifier_gid 20575 2024-01-23T08:05:17.612 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: timed out 2024-01-23T08:05:19.419 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:07.799 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.422 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:07.802 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.450 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:07.829 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.474 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:07.854 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.476 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:07.856 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.476 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:07.813 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.479 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:07.816 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.501 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:07.881 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:19.509 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:07.846 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.327 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:12.707 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.332 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:12.712 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.345 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:12.725 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.378 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:12.758 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.380 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:12.716 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.382 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:12.718 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.382 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:12.762 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.393 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:12.729 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:24.394 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:12.774 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: flushing 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: flushed 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3104 ms) 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: trying... 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389036112 notify_id 4475355922437 notifier_gid 20575 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: timed out 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: flushing 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: flushed 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3258 ms) 2024-01-23T08:05:33.684 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: List watches 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: notify2 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389036112 notify_id 4475355922440 notifier_gid 20575 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: notify2 done 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: watch_check 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: unwatch2 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: flushing 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: done 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3302 ms) 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: List watches 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: notify2 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: handle_notify cookie 94064389036112 notify_id 4479650889734 notifier_gid 20575 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: notify2 done 2024-01-23T08:05:33.685 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: watch_check 2024-01-23T08:05:33.686 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: unwatch2 2024-01-23T08:05:33.686 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: flushing 2024-01-23T08:05:33.686 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: done 2024-01-23T08:05:33.686 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3213 ms) 2024-01-23T08:05:33.687 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (18748 ms total) 2024-01-23T08:05:33.687 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: 2024-01-23T08:05:33.687 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-01-23T08:05:33.687 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (1840201 ms total) 2024-01-23T08:05:33.687 INFO:tasks.workunit.client.0.smithi116.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-01-23T08:05:33.688 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.688 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41358 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41358 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41407 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41407 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40583 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40583 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41239 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41239 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41107 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41107 2024-01-23T08:05:33.689 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40465 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40465 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40529 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40529 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41130 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41130 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40456 2024-01-23T08:05:33.690 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40456 2024-01-23T08:05:34.543 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:22.923 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.549 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:22.928 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.580 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:22.960 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.606 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:22.942 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.608 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:22.988 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.614 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:22.994 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.621 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:22.957 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.645 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:23.024 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:34.655 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:22.992 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.538 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:32.917 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.583 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:32.920 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.585 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:32.964 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.587 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:32.923 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.608 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:32.945 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.620 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:32.999 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.645 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:33.025 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.647 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:33.026 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:44.678 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:33.058 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.540 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:42.919 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.543 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:42.923 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.570 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:42.950 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.595 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:42.975 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.596 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:42.933 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.598 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:42.934 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.598 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:42.978 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.621 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:43.001 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:05:54.624 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:42.961 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.687 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:53.066 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.759 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:53.139 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.759 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:53.139 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.768 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:53.148 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.803 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:53.183 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.808 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:53.188 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.816 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:53.152 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.820 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:53.156 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:04.848 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:53.184 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.598 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:57.977 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.602 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:57.981 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.616 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:33:57.996 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.651 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:57.987 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.652 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:58.032 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.654 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:57.991 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.657 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:58.037 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.667 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:33:58.004 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:09.671 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:33:58.051 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.586 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:02.965 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.637 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:03.016 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.645 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:02.982 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.648 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:02.984 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.665 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:03.002 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.679 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:03.058 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.703 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:03.082 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.707 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:03.086 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:14.723 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:03.103 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.678 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:13.057 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.684 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:13.064 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.714 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:13.093 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.735 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:13.072 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.737 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:13.073 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.740 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:13.120 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.746 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:13.126 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.758 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:13.094 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:24.772 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:13.151 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.504 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:13.840 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.505 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:13.841 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.514 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:13.850 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.576 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:13.955 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.577 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:13.957 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.586 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:13.966 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.606 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:13.986 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.607 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:13.987 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:25.616 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:13.996 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.869 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:28.248 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.923 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:28.259 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.924 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:28.261 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.933 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:28.313 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.937 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:28.317 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.937 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:28.317 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.955 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:28.292 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.972 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:28.352 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:39.990 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:28.370 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.747 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:33.127 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.751 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:33.130 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.764 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:33.144 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.796 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:33.176 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.799 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:33.179 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.800 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:33.136 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.801 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:33.137 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.813 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:33.149 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:44.816 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:33.196 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.609 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:34.989 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.615 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:34.995 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.631 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:35.011 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.663 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:35.000 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.664 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:35.001 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.679 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:35.059 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.682 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:35.018 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.684 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:35.064 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:46.709 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:35.089 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.167 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-01-23T08:06:54.167 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-01-23T08:06:54.167 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (9636 ms) 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (1823665 ms) 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (7096 ms) 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3238 ms) 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3402 ms) 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3420 ms) 2024-01-23T08:06:54.168 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3644 ms) 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3336 ms) 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3290 ms) 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3501 ms) 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3250 ms) 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3478 ms) 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2547 ms) 2024-01-23T08:06:54.169 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3580 ms) 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3368 ms) 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3310 ms) 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3415 ms) 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3345 ms) 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3414 ms) 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3387 ms) 2024-01-23T08:06:54.170 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3238 ms) 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3266 ms) 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3682 ms) 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3326 ms) 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3337 ms) 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3442 ms) 2024-01-23T08:06:54.171 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-01-23T08:06:54.771 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:43.150 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.819 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:43.198 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.840 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:43.220 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.863 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:43.199 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.864 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:43.201 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.866 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:43.245 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.871 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:43.251 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.884 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:43.220 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:06:54.895 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:43.275 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:09.991 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:58.370 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:09.995 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:58.375 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:10.039 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:58.375 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:10.042 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:58.379 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:10.045 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:34:58.424 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:10.059 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:58.439 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:10.062 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:58.442 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:10.071 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:34:58.408 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:10.092 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:34:58.472 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.180 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:28.558 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.183 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:28.562 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.231 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:28.567 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.232 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:28.568 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.239 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:28.619 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.251 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:28.631 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.253 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:28.633 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.296 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:28.632 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:40.325 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:28.705 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:44.981 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:33.360 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.027 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:33.363 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.028 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:33.364 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.039 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:33.418 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.042 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:33.378 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.073 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:33.452 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.094 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:33.474 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.099 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:33.479 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:45.116 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:33.495 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.130 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:43.509 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.134 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:43.514 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.159 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:43.539 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.179 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:43.516 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.180 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:43.560 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.182 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:43.518 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.184 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:43.564 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.206 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:43.542 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:07:55.210 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:43.590 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.198 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:53.577 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.200 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:53.580 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.223 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:53.602 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.246 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:53.582 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.246 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:53.626 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.247 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:53.583 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.248 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:53.628 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.268 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:53.604 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:05.271 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:53.651 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.211 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:58.590 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.212 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:58.592 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.230 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:58.610 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.238 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:35:58.618 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.256 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:58.592 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.258 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:58.594 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.271 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:35:58.607 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.274 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:58.654 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:10.294 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:35:58.674 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.408 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:13.787 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.411 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:13.791 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.441 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:13.820 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.456 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:13.836 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.457 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:13.794 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.457 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:13.837 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.458 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:13.795 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.486 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:13.866 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:25.487 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:13.824 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.326 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:18.706 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.394 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:18.773 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.413 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:18.792 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.443 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:18.823 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.444 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:18.824 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.450 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:18.786 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.451 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:18.788 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.458 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:18.838 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:30.467 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:18.803 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.132 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:29.512 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.144 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:29.523 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.172 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:29.552 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.187 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:29.523 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.192 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:29.571 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.193 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:29.573 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.193 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:29.529 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.220 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:29.556 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:41.221 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:29.601 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.313 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:33.692 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.363 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:33.742 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.368 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:33.704 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.370 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:33.707 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.379 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:33.759 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.384 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:33.721 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.408 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:33.788 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.414 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:33.794 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:45.430 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:33.810 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.370 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:38.749 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.375 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:38.755 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.394 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:38.774 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.419 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:38.755 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.421 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:38.758 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.426 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:38.806 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.430 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:38.810 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.436 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:38.772 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:08:50.445 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:38.825 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.409 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:48.788 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.411 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:48.790 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.436 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:48.816 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.454 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:48.834 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.460 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:48.839 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.460 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:48.796 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.462 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:48.798 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.484 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:48.863 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:00.485 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:48.821 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.524 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:58.904 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.570 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:58.907 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.571 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:58.951 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.574 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:58.911 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.594 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:36:58.974 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.596 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:36:58.932 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.620 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:58.999 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.623 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:59.003 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:10.649 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:36:59.029 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.521 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:03.900 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.522 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:03.859 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.524 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:03.903 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.530 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:03.910 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.572 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:03.909 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.591 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:03.928 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.594 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:03.974 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.611 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:03.991 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:15.614 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:03.993 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.697 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:19.033 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.699 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:19.079 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.701 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:19.038 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.704 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:19.084 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.733 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:19.112 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.737 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:19.074 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.756 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:19.136 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.760 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:19.140 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:30.789 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:19.169 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:34.777 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripAppendPP (3272 ms) 2024-01-23T08:09:34.777 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-01-23T08:09:34.777 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3578 ms) 2024-01-23T08:09:34.777 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-01-23T08:09:34.777 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3310 ms) 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3347 ms) 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: setting pool EIO 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: max_success 146, min_failed 147 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (7531 ms) 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (4008 ms) 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (1942659 ms total) 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3240 ms) 2024-01-23T08:09:34.778 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9130 ms) 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15840 ms) 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3679 ms) 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (31889 ms total) 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3582 ms) 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3582 ms total) 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: 2024-01-23T08:09:34.779 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (15633 ms) 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (8046 ms) 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7780 ms) 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7454 ms) 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3321 ms) 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6831 ms) 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-01-23T08:09:34.780 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7928 ms) 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7129 ms) 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7851 ms) 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7255 ms) 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (9370 ms) 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7939 ms) 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-01-23T08:09:34.781 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6827 ms) 2024-01-23T08:09:45.550 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:33.929 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.599 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:33.978 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.629 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:34.008 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.647 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:33.983 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.648 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:34.028 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.648 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:33.985 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.651 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:34.031 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.679 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:34.016 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:45.681 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:34.061 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.633 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:39.012 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.637 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:39.017 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.662 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:39.042 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.683 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:39.020 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.686 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:39.022 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.690 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:39.070 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.694 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:39.074 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.701 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:39.037 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:09:50.710 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:39.090 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.662 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:49.041 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.665 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:49.045 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.689 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:49.069 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.713 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:49.049 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.714 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:49.093 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.715 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:49.052 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.717 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:49.096 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.736 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:49.073 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:00.739 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:49.118 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.758 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:59.137 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.805 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:59.185 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.809 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:59.189 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.809 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:59.189 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.844 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:37:59.223 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.844 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:37:59.223 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.853 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:59.190 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.855 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:59.191 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:10.877 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:37:59.213 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.729 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:04.108 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.731 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:04.111 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.743 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:04.123 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.775 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:04.155 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.777 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:04.114 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.778 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:04.158 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.779 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:04.116 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.792 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:04.128 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:15.792 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:04.172 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-01-23T08:10:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3397 ms) 2024-01-23T08:10:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-01-23T08:10:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6761 ms) 2024-01-23T08:10:24.080 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (9115 ms) 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7388 ms) 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7686 ms) 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7372 ms) 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7581 ms) 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (152665 ms total) 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-01-23T08:10:24.081 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (2130795 ms total) 2024-01-23T08:10:24.082 INFO:tasks.workunit.client.0.smithi116.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-01-23T08:10:24.085 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.085 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40477 2024-01-23T08:10:24.085 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40477 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41509 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41509 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40672 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40672 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41552 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41552 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40722 2024-01-23T08:10:24.086 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40722 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41321 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41321 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41621 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41621 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40683 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40683 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41159 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41159 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.087 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41489 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41489 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41305 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41305 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41520 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41520 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41044 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41044 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40619 2024-01-23T08:10:24.088 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40619 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41564 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41564 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40930 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40930 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40449 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40449 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40509 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40509 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.089 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40832 2024-01-23T08:10:24.090 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40832 2024-01-23T08:10:24.090 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.090 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40550 2024-01-23T08:10:24.090 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40550 2024-01-23T08:10:24.090 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.090 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=40973 2024-01-23T08:10:24.091 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 40973 2024-01-23T08:10:24.091 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41014 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41014 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41477 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41477 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ for t in "${!pids[@]}" 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ pid=41649 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ wait 41649 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ exit 0 2024-01-23T08:10:24.092 INFO:tasks.workunit.client.0.smithi116.stderr:+ cleanup 2024-01-23T08:10:24.093 INFO:tasks.workunit.client.0.smithi116.stderr:+ pkill -P 40444 2024-01-23T08:10:24.159 INFO:tasks.workunit.client.0.smithi116.stderr:+ true 2024-01-23T08:10:24.159 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-23T08:10:24.159 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-23T08:10:24.205 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2024-01-23T08:10:24.205 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-23T08:10:24.467 DEBUG:teuthology.parallel:result is None 2024-01-23T08:10:24.468 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-23T08:10:24.495 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-23T08:10:24.495 DEBUG:teuthology.orchestra.run.smithi116:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-01-23T08:10:24.555 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-01-23T08:10:24.556 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-23T08:10:24.567 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-23T08:10:24.567 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.697+0000 7fa26b712640 10 monclient: get_monmap_and_config 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.697+0000 7fa26b712640 10 monclient: build_initial_monmap 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.697+0000 7fa26b712640 10 monclient: monmap: 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:24.698954+0000 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:24.698954+0000 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:24.698 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:24.699 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:24.699 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:24.699 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:24.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.698+0000 7fa26b712640 1 Processor -- start 2024-01-23T08:10:24.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.698+0000 7fa26b712640 1 -- start start 2024-01-23T08:10:24.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.698+0000 7fa26b712640 10 monclient: init 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient: _add_conns ranks=[0,1,3,4,2] 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa26406b200 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fa2640ad880 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa26413f8c0 0x7fa26414d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient(hunting): picked mon.noname-a con 0x7fa26413f8c0 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26406d170 con 0x7fa26406b200 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26406d450 con 0x7fa2640ad880 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2641420c0 con 0x7fa26413f8c0 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa26b712640 10 monclient(hunting): authenticate will time out at 4632.057352s 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa269caf640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fa26413f8c0 0x7fa26414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:24.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa268cad640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7fa2640ad880 0x7fa26413f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:38798/0 (socket says 172.21.15.116:38798) 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.699+0000 7fa268cad640 1 -- 172.21.15.116:0/2142064881 learned_addr learned my addr 172.21.15.116:0/2142064881 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.700+0000 7fa269caf640 10 monclient(hunting): get_auth_request con 0x7fa26413f8c0 auth_method 0 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.700+0000 7fa269caf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.700+0000 7fa269caf640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.700+0000 7fa269caf640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.701+0000 7fa269caf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.701+0000 7fa269caf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.701+0000 7fa269caf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.702+0000 7fa257fff640 1 -- 172.21.15.116:0/2142064881 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016894484 0 0) 0x7fa26406d450 con 0x7fa2640ad880 2024-01-23T08:10:24.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.702+0000 7fa257fff640 10 monclient(hunting): _negotiate 2024-01-23T08:10:24.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.702+0000 7fa257fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:24.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.702+0000 7fa257fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:24.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.702+0000 7fa257fff640 10 monclient(hunting): my global_id is 20899 2024-01-23T08:10:24.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.702+0000 7fa257fff640 1 -- 172.21.15.116:0/2142064881 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa250003520 con 0x7fa2640ad880 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 10 monclient(hunting): handle_auth_done global_id 16497 payload 274 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 1 -- 172.21.15.116:0/2142064881 >> v1:172.21.15.173:6789/0 conn(0x7fa2640ad880 legacy=0x7fa26413f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 1 -- 172.21.15.116:0/2142064881 >> v1:172.21.15.116:6789/0 conn(0x7fa26406b200 legacy=0x7fa2641425e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 10 monclient: _finish_hunting 0 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 1 monclient: found mon.noname-a 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:24.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.704+0000 7fa269caf640 1 -- 172.21.15.116:0/2142064881 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26406d730 con 0x7fa26413f8c0 2024-01-23T08:10:24.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.707+0000 7fa269caf640 1 --2- 172.21.15.116:0/2142064881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa26413f8c0 0x7fa26414d870 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009d90 tx=0x7fa25c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9719b361d43b66dd server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 1 -- 172.21.15.116:0/2142064881 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c02cc60 con 0x7fa26413f8c0 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: dump: 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.711 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: _finish_auth 0 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 1 -- 172.21.15.116:0/2142064881 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c02cdc0 con 0x7fa26413f8c0 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 1 -- 172.21.15.116:0/2142064881 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c034660 con 0x7fa26413f8c0 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:24.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa257fff640 10 monclient: dump: 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa26b712640 5 monclient: authenticate success, global_id 16497 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa26b712640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:24.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa26b712640 4 set_mon_vals no callback set 2024-01-23T08:10:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa26b712640 10 monclient: shutdown 2024-01-23T08:10:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa26b712640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa26b712640 1 -- 172.21.15.116:0/2142064881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa26413f8c0 msgr2=0x7fa26414d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:24.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.711+0000 7fa26b712640 1 --2- 172.21.15.116:0/2142064881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa26413f8c0 0x7fa26414d870 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009d90 tx=0x7fa25c02beb0 comp rx=0 tx=0).stop 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 1 -- 172.21.15.116:0/2142064881 shutdown_connections 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 1 --2- 172.21.15.116:0/2142064881 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa26413f8c0 0x7fa26414d870 unknown :-1 s=CLOSED pgs=3235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 1 -- 172.21.15.116:0/2142064881 >> 172.21.15.116:0/2142064881 conn(0x7fa2640b1f50 msgr2=0x7fa2640af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 1 -- 172.21.15.116:0/2142064881 shutdown_connections 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 1 -- 172.21.15.116:0/2142064881 wait complete. 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 10 monclient: build_initial_monmap 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 10 monclient: monmap: 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:24.719 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 1 librados: starting msgr at 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.712+0000 7fa26b712640 1 librados: starting objecter 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 Processor -- start 2024-01-23T08:10:24.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 -- start start 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 librados: setting wanted keys 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 librados: calling monclient init 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient: init 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa26406b200 0x7fa2641c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): picked mon.noname-b con 0x7fa26406b200 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2640ad880 0x7fa2641dafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): picked mon.noname-a con 0x7fa2640ad880 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa26413f8c0 0x7fa2641d7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): picked mon.noname-c con 0x7fa26413f8c0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26413e7f0 con 0x7fa2640ad880 2024-01-23T08:10:24.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2641dab10 con 0x7fa26406b200 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26413ea40 con 0x7fa26413f8c0 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.713+0000 7fa26b712640 10 monclient(hunting): authenticate will time out at 4632.071932s 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa268cad640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2640ad880 0x7fa2641dafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa2694ae640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa26406b200 0x7fa2641c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa269caf640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa26413f8c0 0x7fa2641d7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa268cad640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2640ad880 0x7fa2641dafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49942/0 (socket says 172.21.15.116:49942) 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa268cad640 1 -- 172.21.15.116:0/2275172743 learned_addr learned my addr 172.21.15.116:0/2275172743 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa268cad640 10 monclient(hunting): get_auth_request con 0x7fa2640ad880 auth_method 0 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa268cad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa268cad640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:24.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa268cad640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa2694ae640 10 monclient(hunting): get_auth_request con 0x7fa26406b200 auth_method 0 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa2694ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa2694ae640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa2694ae640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa269caf640 10 monclient(hunting): get_auth_request con 0x7fa26413f8c0 auth_method 0 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa269caf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa269caf640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.714+0000 7fa269caf640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa2694ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa2694ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa2694ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa268cad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa268cad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa268cad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:24.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa269caf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa269caf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.715+0000 7fa269caf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 10 monclient(hunting): handle_auth_done global_id 20902 payload 824 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 1 -- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa26413f8c0 msgr2=0x7fa2641d7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa26413f8c0 0x7fa2641d7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 1 -- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2640ad880 msgr2=0x7fa2641dafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2640ad880 0x7fa2641dafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 10 monclient: _finish_hunting 0 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 1 monclient: found mon.noname-b 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:24.724 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.717+0000 7fa2694ae640 1 -- 172.21.15.116:0/2275172743 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c009a70 con 0x7fa26406b200 2024-01-23T08:10:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.719+0000 7fa2694ae640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa26406b200 0x7fa2641c9a70 secure :-1 s=READY pgs=5209 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c340 tx=0x7fa25800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.719+0000 7fa255ffb640 10 client.?.objecter ms_handle_connect 0x7fa26406b200 2024-01-23T08:10:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.720+0000 7fa255ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa255ffb640 1 -- 172.21.15.116:0/2275172743 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580052d0 con 0x7fa26406b200 2024-01-23T08:10:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa255ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa255ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:24.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa255ffb640 10 monclient: dump: 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa255ffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa255ffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa255ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 5 monclient: authenticate success, global_id 20902 2024-01-23T08:10:24.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 10 monclient: _renew_subs 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2641d75a0 con 0x7fa26406b200 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 10 client.20902.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 10 monclient: _renew_subs 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa264141dd0 con 0x7fa26406b200 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.722+0000 7fa26b712640 1 librados: init done 2024-01-23T08:10:24.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.723+0000 7fa26b712640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:24.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.723+0000 7fa26b712640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:24.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.723+0000 7fa26b712640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:24.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.723+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26404ea10 con 0x7fa26406b200 2024-01-23T08:10:24.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.723+0000 7fa255ffb640 1 -- 172.21.15.116:0/2275172743 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258005430 con 0x7fa26406b200 2024-01-23T08:10:24.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.723+0000 7fa255ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:24.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.723+0000 7fa2577fe640 4 set_mon_vals no callback set 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.965+0000 7fa255ffb640 1 -- 172.21.15.116:0/2275172743 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258007220 con 0x7fa26406b200 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.965+0000 7fa255ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.965+0000 7fa255ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.965+0000 7fa255ffb640 10 monclient: dump: 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:24.965 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:24.966 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:24.966 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.965+0000 7fa255ffb640 1 -- 172.21.15.116:0/2275172743 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fa258007440 con 0x7fa26406b200 2024-01-23T08:10:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.966+0000 7fa255ffb640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa24806c860 0x7fa24806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.966+0000 7fa268cad640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa24806c860 0x7fa24806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.966+0000 7fa268cad640 10 monclient: get_auth_request con 0x7fa24806c860 auth_method 0 2024-01-23T08:10:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.966+0000 7fa255ffb640 10 client.20902.objecter ms_handle_connect 0x7fa24806c860 2024-01-23T08:10:24.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.966+0000 7fa268cad640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa24806c860 0x7fa24806ed20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa2640b4450 tx=0x7fa260009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.969+0000 7fa255ffb640 1 -- 172.21.15.116:0/2275172743 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1322..1322 src has 1032..1322) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fa258057a90 con 0x7fa26406b200 2024-01-23T08:10:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.969+0000 7fa255ffb640 10 client.20902.objecter ms_dispatch 0x7fa264000b90 osd_map(1322..1322 src has 1032..1322) v4 2024-01-23T08:10:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.969+0000 7fa255ffb640 3 client.20902.objecter handle_osd_map got epochs [1322,1322] > 0 2024-01-23T08:10:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.969+0000 7fa255ffb640 3 client.20902.objecter handle_osd_map decoding full epoch 1322 2024-01-23T08:10:24.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.969+0000 7fa255ffb640 20 client.20902.objecter dump_active .. 0 homeless 2024-01-23T08:10:24.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.980+0000 7fa255ffb640 1 -- 172.21.15.116:0/2275172743 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fa258053dd0 con 0x7fa26406b200 2024-01-23T08:10:24.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.980+0000 7fa255ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:24.980 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:24.980+0000 7fa255ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:25.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.159+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2641dac50 con 0x7fa24806c860 2024-01-23T08:10:25.165 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.164+0000 7fa255ffb640 1 -- 172.21.15.116:0/2275172743 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151851 (secure 0 0 0) 0x7fa26000f820 con 0x7fa24806c860 2024-01-23T08:10:25.167 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T08:10:25.167 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-01-23T08:10:25.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 10 librados: watch_flush enter 2024-01-23T08:10:25.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 10 librados: watch_flush exit 2024-01-23T08:10:25.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 20 client.20902.objecter shutdown clearing up homeless session... 2024-01-23T08:10:25.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 10 client.20902.objecter successfully canceled tick 2024-01-23T08:10:25.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa24806c860 msgr2=0x7fa24806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa24806c860 0x7fa24806ed20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa2640b4450 tx=0x7fa260009040 comp rx=0 tx=0).stop 2024-01-23T08:10:25.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 10 monclient: shutdown 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa26406b200 msgr2=0x7fa2641c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa26406b200 0x7fa2641c9a70 secure :-1 s=READY pgs=5209 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c340 tx=0x7fa25800c800 comp rx=0 tx=0).stop 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 shutdown_connections 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fa24806c860 0x7fa24806ed20 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fa26413f8c0 0x7fa2641d7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa2640ad880 0x7fa2641dafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 --2- 172.21.15.116:0/2275172743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa26406b200 0x7fa2641c9a70 unknown :-1 s=CLOSED pgs=5209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 >> 172.21.15.116:0/2275172743 conn(0x7fa2640b1f50 msgr2=0x7fa2641425e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 shutdown_connections 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 -- 172.21.15.116:0/2275172743 wait complete. 2024-01-23T08:10:25.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.167+0000 7fa26b712640 1 librados: shutdown 2024-01-23T08:10:25.179 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2440,"stamp":"2024-01-23T08:10:25.070410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":581652,"kb_used_data":39252,"kb_used_omap":12,"kb_used_meta":542259,"kb_avail":754393068,"statfs":{"total":773094113280,"available":772498501632,"internally_reserved":0,"allocated":40194048,"data_stored":18746531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":555273776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":200,"apply_latency_ms":200,"commit_latency_ns":200000000,"apply_latency_ns":200000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.260333"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":2543,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.918403+0000","last_change":"2024-01-23T07:35:49.772956+0000","last_active":"2024-01-23T08:10:20.918403+0000","last_peered":"2024-01-23T08:10:20.918403+0000","last_clean":"2024-01-23T08:10:20.918403+0000","last_became_active":"2024-01-23T07:35:49.767110+0000","last_became_peered":"2024-01-23T07:35:49.767110+0000","last_unstale":"2024-01-23T08:10:20.918403+0000","last_undegraded":"2024-01-23T08:10:20.918403+0000","last_fullsized":"2024-01-23T08:10:20.918403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:11:19.875803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":2538,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.912573+0000","last_change":"2024-01-23T07:46:17.396184+0000","last_active":"2024-01-23T08:10:20.912573+0000","last_peered":"2024-01-23T08:10:20.912573+0000","last_clean":"2024-01-23T08:10:20.912573+0000","last_became_active":"2024-01-23T07:46:17.386551+0000","last_became_peered":"2024-01-23T07:46:17.386551+0000","last_unstale":"2024-01-23T08:10:20.912573+0000","last_undegraded":"2024-01-23T08:10:20.912573+0000","last_fullsized":"2024-01-23T08:10:20.912573+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:18:07.924980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":2067,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.024512+0000","last_change":"2024-01-23T07:40:37.949256+0000","last_active":"2024-01-23T08:10:23.024512+0000","last_peered":"2024-01-23T08:10:23.024512+0000","last_clean":"2024-01-23T08:10:23.024512+0000","last_became_active":"2024-01-23T07:40:37.943110+0000","last_became_peered":"2024-01-23T07:40:37.943110+0000","last_unstale":"2024-01-23T08:10:23.024512+0000","last_undegraded":"2024-01-23T08:10:23.024512+0000","last_fullsized":"2024-01-23T08:10:23.024512+0000","mapping_epoch":276,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":277,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:47:53.342128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":2524,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.613576+0000","last_change":"2024-01-23T07:35:17.672440+0000","last_active":"2024-01-23T08:10:17.613576+0000","last_peered":"2024-01-23T08:10:17.613576+0000","last_clean":"2024-01-23T08:10:17.613576+0000","last_became_active":"2024-01-23T07:35:17.664344+0000","last_became_peered":"2024-01-23T07:35:17.664344+0000","last_unstale":"2024-01-23T08:10:17.613576+0000","last_undegraded":"2024-01-23T08:10:17.613576+0000","last_fullsized":"2024-01-23T08:10:17.613576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:29:47.794690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.602445+0000","last_change":"2024-01-23T07:35:53.501964+0000","last_active":"2024-01-23T08:10:17.602445+0000","last_peered":"2024-01-23T08:10:17.602445+0000","last_clean":"2024-01-23T08:10:17.602445+0000","last_became_active":"2024-01-23T07:35:53.492743+0000","last_became_peered":"2024-01-23T07:35:53.492743+0000","last_unstale":"2024-01-23T08:10:17.602445+0000","last_undegraded":"2024-01-23T08:10:17.602445+0000","last_fullsized":"2024-01-23T08:10:17.602445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:57:15.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":2533,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.872031+0000","last_change":"2024-01-23T07:46:16.359928+0000","last_active":"2024-01-23T08:10:20.872031+0000","last_peered":"2024-01-23T08:10:20.872031+0000","last_clean":"2024-01-23T08:10:20.872031+0000","last_became_active":"2024-01-23T07:46:16.353670+0000","last_became_peered":"2024-01-23T07:46:16.353670+0000","last_unstale":"2024-01-23T08:10:20.872031+0000","last_undegraded":"2024-01-23T08:10:20.872031+0000","last_fullsized":"2024-01-23T08:10:20.872031+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:55:34.799754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.637288+0000","last_change":"2024-01-23T07:35:17.534265+0000","last_active":"2024-01-23T08:10:17.637288+0000","last_peered":"2024-01-23T08:10:17.637288+0000","last_clean":"2024-01-23T08:10:17.637288+0000","last_became_active":"2024-01-23T07:35:17.521909+0000","last_became_peered":"2024-01-23T07:35:17.521909+0000","last_unstale":"2024-01-23T08:10:17.637288+0000","last_undegraded":"2024-01-23T08:10:17.637288+0000","last_fullsized":"2024-01-23T08:10:17.637288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:42:31.245205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":2525,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.884563+0000","last_change":"2024-01-23T07:46:17.614578+0000","last_active":"2024-01-23T08:10:20.884563+0000","last_peered":"2024-01-23T08:10:20.884563+0000","last_clean":"2024-01-23T08:10:20.884563+0000","last_became_active":"2024-01-23T07:46:17.609277+0000","last_became_peered":"2024-01-23T07:46:17.609277+0000","last_unstale":"2024-01-23T08:10:20.884563+0000","last_undegraded":"2024-01-23T08:10:20.884563+0000","last_fullsized":"2024-01-23T08:10:20.884563+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:04:31.637396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.606279+0000","last_change":"2024-01-23T07:35:17.515370+0000","last_active":"2024-01-23T08:10:17.606279+0000","last_peered":"2024-01-23T08:10:17.606279+0000","last_clean":"2024-01-23T08:10:17.606279+0000","last_became_active":"2024-01-23T07:35:17.510073+0000","last_became_peered":"2024-01-23T07:35:17.510073+0000","last_unstale":"2024-01-23T08:10:17.606279+0000","last_undegraded":"2024-01-23T08:10:17.606279+0000","last_fullsized":"2024-01-23T08:10:17.606279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:27:19.993768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":2527,"reported_epoch":1320,"state":"active+clean","last_fresh":"2024-01-23T08:10:21.887611+0000","last_change":"2024-01-23T07:35:53.382362+0000","last_active":"2024-01-23T08:10:21.887611+0000","last_peered":"2024-01-23T08:10:21.887611+0000","last_clean":"2024-01-23T08:10:21.887611+0000","last_became_active":"2024-01-23T07:35:53.376441+0000","last_became_peered":"2024-01-23T07:35:53.376441+0000","last_unstale":"2024-01-23T08:10:21.887611+0000","last_undegraded":"2024-01-23T08:10:21.887611+0000","last_fullsized":"2024-01-23T08:10:21.887611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:51:04.227769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":2558,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.027092+0000","last_change":"2024-01-23T07:35:26.286843+0000","last_active":"2024-01-23T08:10:23.027092+0000","last_peered":"2024-01-23T08:10:23.027092+0000","last_clean":"2024-01-23T08:10:23.027092+0000","last_became_active":"2024-01-23T07:35:26.273730+0000","last_became_peered":"2024-01-23T07:35:26.273730+0000","last_unstale":"2024-01-23T08:10:23.027092+0000","last_undegraded":"2024-01-23T08:10:23.027092+0000","last_fullsized":"2024-01-23T08:10:23.027092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:14:11.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":2516,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.503436+0000","last_change":"2024-01-23T07:36:02.469027+0000","last_active":"2024-01-23T08:10:19.503436+0000","last_peered":"2024-01-23T08:10:19.503436+0000","last_clean":"2024-01-23T08:10:19.503436+0000","last_became_active":"2024-01-23T07:36:02.460264+0000","last_became_peered":"2024-01-23T07:36:02.460264+0000","last_unstale":"2024-01-23T08:10:19.503436+0000","last_undegraded":"2024-01-23T08:10:19.503436+0000","last_fullsized":"2024-01-23T08:10:19.503436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:21:58.260272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'76","reported_seq":2545,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.488630+0000","last_change":"2024-01-23T07:33:26.319611+0000","last_active":"2024-01-23T08:10:19.488630+0000","last_peered":"2024-01-23T08:10:19.488630+0000","last_clean":"2024-01-23T08:10:19.488630+0000","last_became_active":"2024-01-23T07:33:25.600297+0000","last_became_peered":"2024-01-23T07:33:25.600297+0000","last_unstale":"2024-01-23T08:10:19.488630+0000","last_undegraded":"2024-01-23T08:10:19.488630+0000","last_fullsized":"2024-01-23T08:10:19.488630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_clean_scrub_stamp":"2024-01-23T07:33:13.116593+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:32:26.093374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.647887+0000","last_change":"2024-01-23T07:33:32.660913+0000","last_active":"2024-01-23T08:10:19.647887+0000","last_peered":"2024-01-23T08:10:19.647887+0000","last_clean":"2024-01-23T08:10:19.647887+0000","last_became_active":"2024-01-23T07:33:32.655848+0000","last_became_peered":"2024-01-23T07:33:32.655848+0000","last_unstale":"2024-01-23T08:10:19.647887+0000","last_undegraded":"2024-01-23T08:10:19.647887+0000","last_fullsized":"2024-01-23T08:10:19.647887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:09:57.469855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":2556,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.013548+0000","last_change":"2024-01-23T07:35:08.880758+0000","last_active":"2024-01-23T08:10:23.013548+0000","last_peered":"2024-01-23T08:10:23.013548+0000","last_clean":"2024-01-23T08:10:23.013548+0000","last_became_active":"2024-01-23T07:35:08.862294+0000","last_became_peered":"2024-01-23T07:35:08.862294+0000","last_unstale":"2024-01-23T08:10:23.013548+0000","last_undegraded":"2024-01-23T08:10:23.013548+0000","last_fullsized":"2024-01-23T08:10:23.013548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:51:07.605185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.621092+0000","last_change":"2024-01-23T07:33:32.273001+0000","last_active":"2024-01-23T08:10:19.621092+0000","last_peered":"2024-01-23T08:10:19.621092+0000","last_clean":"2024-01-23T08:10:19.621092+0000","last_became_active":"2024-01-23T07:33:32.242199+0000","last_became_peered":"2024-01-23T07:33:32.242199+0000","last_unstale":"2024-01-23T08:10:19.621092+0000","last_undegraded":"2024-01-23T08:10:19.621092+0000","last_fullsized":"2024-01-23T08:10:19.621092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:00:09.885876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":2517,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.591970+0000","last_change":"2024-01-23T07:35:57.074880+0000","last_active":"2024-01-23T08:10:19.591970+0000","last_peered":"2024-01-23T08:10:19.591970+0000","last_clean":"2024-01-23T08:10:19.591970+0000","last_became_active":"2024-01-23T07:35:57.067585+0000","last_became_peered":"2024-01-23T07:35:57.067585+0000","last_unstale":"2024-01-23T08:10:19.591970+0000","last_undegraded":"2024-01-23T08:10:19.591970+0000","last_fullsized":"2024-01-23T08:10:19.591970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:55:33.167910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2546,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.876825+0000","last_change":"2024-01-23T07:46:17.828288+0000","last_active":"2024-01-23T08:10:20.876825+0000","last_peered":"2024-01-23T08:10:20.876825+0000","last_clean":"2024-01-23T08:10:20.876825+0000","last_became_active":"2024-01-23T07:46:17.822757+0000","last_became_peered":"2024-01-23T07:46:17.822757+0000","last_unstale":"2024-01-23T08:10:20.876825+0000","last_undegraded":"2024-01-23T08:10:20.876825+0000","last_fullsized":"2024-01-23T08:10:20.876825+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:16:46.198098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.616541+0000","last_change":"2024-01-23T07:35:17.207540+0000","last_active":"2024-01-23T08:10:17.616541+0000","last_peered":"2024-01-23T08:10:17.616541+0000","last_clean":"2024-01-23T08:10:17.616541+0000","last_became_active":"2024-01-23T07:35:17.149780+0000","last_became_peered":"2024-01-23T07:35:17.149780+0000","last_unstale":"2024-01-23T08:10:17.616541+0000","last_undegraded":"2024-01-23T08:10:17.616541+0000","last_fullsized":"2024-01-23T08:10:17.616541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:36:31.573133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.641389+0000","last_change":"2024-01-23T07:33:32.478085+0000","last_active":"2024-01-23T08:10:19.641389+0000","last_peered":"2024-01-23T08:10:19.641389+0000","last_clean":"2024-01-23T08:10:19.641389+0000","last_became_active":"2024-01-23T07:33:32.468117+0000","last_became_peered":"2024-01-23T07:33:32.468117+0000","last_unstale":"2024-01-23T08:10:19.641389+0000","last_undegraded":"2024-01-23T08:10:19.641389+0000","last_fullsized":"2024-01-23T08:10:19.641389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:53:49.321585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":2562,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.019762+0000","last_change":"2024-01-23T07:46:17.171650+0000","last_active":"2024-01-23T08:10:23.019762+0000","last_peered":"2024-01-23T08:10:23.019762+0000","last_clean":"2024-01-23T08:10:23.019762+0000","last_became_active":"2024-01-23T07:46:17.164304+0000","last_became_peered":"2024-01-23T07:46:17.164304+0000","last_unstale":"2024-01-23T08:10:23.019762+0000","last_undegraded":"2024-01-23T08:10:23.019762+0000","last_fullsized":"2024-01-23T08:10:23.019762+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:58.806997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2567,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.016564+0000","last_change":"2024-01-23T07:33:32.481074+0000","last_active":"2024-01-23T08:10:23.016564+0000","last_peered":"2024-01-23T08:10:23.016564+0000","last_clean":"2024-01-23T08:10:23.016564+0000","last_became_active":"2024-01-23T07:33:32.474543+0000","last_became_peered":"2024-01-23T07:33:32.474543+0000","last_unstale":"2024-01-23T08:10:23.016564+0000","last_undegraded":"2024-01-23T08:10:23.016564+0000","last_fullsized":"2024-01-23T08:10:23.016564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:34:40.212856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":2542,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.905321+0000","last_change":"2024-01-23T07:35:28.743786+0000","last_active":"2024-01-23T08:10:20.905321+0000","last_peered":"2024-01-23T08:10:20.905321+0000","last_clean":"2024-01-23T08:10:20.905321+0000","last_became_active":"2024-01-23T07:35:28.738559+0000","last_became_peered":"2024-01-23T07:35:28.738559+0000","last_unstale":"2024-01-23T08:10:20.905321+0000","last_undegraded":"2024-01-23T08:10:20.905321+0000","last_fullsized":"2024-01-23T08:10:20.905321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:43:03.397366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.655956+0000","last_change":"2024-01-23T07:33:32.371113+0000","last_active":"2024-01-23T08:10:19.655956+0000","last_peered":"2024-01-23T08:10:19.655956+0000","last_clean":"2024-01-23T08:10:19.655956+0000","last_became_active":"2024-01-23T07:33:32.353826+0000","last_became_peered":"2024-01-23T07:33:32.353826+0000","last_unstale":"2024-01-23T08:10:19.655956+0000","last_undegraded":"2024-01-23T08:10:19.655956+0000","last_fullsized":"2024-01-23T08:10:19.655956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:16:09.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":2523,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.589721+0000","last_change":"2024-01-23T07:35:16.873946+0000","last_active":"2024-01-23T08:10:17.589721+0000","last_peered":"2024-01-23T08:10:17.589721+0000","last_clean":"2024-01-23T08:10:17.589721+0000","last_became_active":"2024-01-23T07:35:16.868129+0000","last_became_peered":"2024-01-23T07:35:16.868129+0000","last_unstale":"2024-01-23T08:10:17.589721+0000","last_undegraded":"2024-01-23T08:10:17.589721+0000","last_fullsized":"2024-01-23T08:10:17.589721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:02:37.157717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2551,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.922297+0000","last_change":"2024-01-23T07:33:32.719529+0000","last_active":"2024-01-23T08:10:20.922297+0000","last_peered":"2024-01-23T08:10:20.922297+0000","last_clean":"2024-01-23T08:10:20.922297+0000","last_became_active":"2024-01-23T07:33:32.693171+0000","last_became_peered":"2024-01-23T07:33:32.693171+0000","last_unstale":"2024-01-23T08:10:20.922297+0000","last_undegraded":"2024-01-23T08:10:20.922297+0000","last_fullsized":"2024-01-23T08:10:20.922297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:08:58.102768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":2523,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.599919+0000","last_change":"2024-01-23T07:35:17.021056+0000","last_active":"2024-01-23T08:10:17.599919+0000","last_peered":"2024-01-23T08:10:17.599919+0000","last_clean":"2024-01-23T08:10:17.599919+0000","last_became_active":"2024-01-23T07:35:17.011327+0000","last_became_peered":"2024-01-23T07:35:17.011327+0000","last_unstale":"2024-01-23T08:10:17.599919+0000","last_undegraded":"2024-01-23T08:10:17.599919+0000","last_fullsized":"2024-01-23T08:10:17.599919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:03:58.748267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2546,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.675254+0000","last_change":"2024-01-23T07:33:32.685400+0000","last_active":"2024-01-23T08:10:19.675254+0000","last_peered":"2024-01-23T08:10:19.675254+0000","last_clean":"2024-01-23T08:10:19.675254+0000","last_became_active":"2024-01-23T07:33:32.676672+0000","last_became_peered":"2024-01-23T07:33:32.676672+0000","last_unstale":"2024-01-23T08:10:19.675254+0000","last_undegraded":"2024-01-23T08:10:19.675254+0000","last_fullsized":"2024-01-23T08:10:19.675254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:20:29.458030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":2523,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.592827+0000","last_change":"2024-01-23T07:35:17.450588+0000","last_active":"2024-01-23T08:10:17.592827+0000","last_peered":"2024-01-23T08:10:17.592827+0000","last_clean":"2024-01-23T08:10:17.592827+0000","last_became_active":"2024-01-23T07:35:17.445116+0000","last_became_peered":"2024-01-23T07:35:17.445116+0000","last_unstale":"2024-01-23T08:10:17.592827+0000","last_undegraded":"2024-01-23T08:10:17.592827+0000","last_fullsized":"2024-01-23T08:10:17.592827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:05:00.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":2554,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.009312+0000","last_change":"2024-01-23T07:35:23.296635+0000","last_active":"2024-01-23T08:10:23.009312+0000","last_peered":"2024-01-23T08:10:23.009312+0000","last_clean":"2024-01-23T08:10:23.009312+0000","last_became_active":"2024-01-23T07:35:23.240102+0000","last_became_peered":"2024-01-23T07:35:23.240102+0000","last_unstale":"2024-01-23T08:10:23.009312+0000","last_undegraded":"2024-01-23T08:10:23.009312+0000","last_fullsized":"2024-01-23T08:10:23.009312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:44:36.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":2491,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.633448+0000","last_change":"2024-01-23T07:36:16.164085+0000","last_active":"2024-01-23T08:10:17.633448+0000","last_peered":"2024-01-23T08:10:17.633448+0000","last_clean":"2024-01-23T08:10:17.633448+0000","last_became_active":"2024-01-23T07:36:16.154523+0000","last_became_peered":"2024-01-23T07:36:16.154523+0000","last_unstale":"2024-01-23T08:10:17.633448+0000","last_undegraded":"2024-01-23T08:10:17.633448+0000","last_fullsized":"2024-01-23T08:10:17.633448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:42:08.960329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":2525,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.596530+0000","last_change":"2024-01-23T07:35:53.515139+0000","last_active":"2024-01-23T08:10:17.596530+0000","last_peered":"2024-01-23T08:10:17.596530+0000","last_clean":"2024-01-23T08:10:17.596530+0000","last_became_active":"2024-01-23T07:35:53.509895+0000","last_became_peered":"2024-01-23T07:35:53.509895+0000","last_unstale":"2024-01-23T08:10:17.596530+0000","last_undegraded":"2024-01-23T08:10:17.596530+0000","last_fullsized":"2024-01-23T08:10:17.596530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:27:03.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1","version":"115'7","reported_seq":2546,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.639922+0000","last_change":"2024-01-23T07:35:25.280614+0000","last_active":"2024-01-23T08:10:19.639922+0000","last_peered":"2024-01-23T08:10:19.639922+0000","last_clean":"2024-01-23T08:10:19.639922+0000","last_became_active":"2024-01-23T07:35:25.275034+0000","last_became_peered":"2024-01-23T07:35:25.275034+0000","last_unstale":"2024-01-23T08:10:19.639922+0000","last_undegraded":"2024-01-23T08:10:19.639922+0000","last_fullsized":"2024-01-23T08:10:19.639922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:49:35.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":2520,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.507703+0000","last_change":"2024-01-23T07:35:15.252226+0000","last_active":"2024-01-23T08:10:19.507703+0000","last_peered":"2024-01-23T08:10:19.507703+0000","last_clean":"2024-01-23T08:10:19.507703+0000","last_became_active":"2024-01-23T07:35:15.231845+0000","last_became_peered":"2024-01-23T07:35:15.231845+0000","last_unstale":"2024-01-23T08:10:19.507703+0000","last_undegraded":"2024-01-23T08:10:19.507703+0000","last_fullsized":"2024-01-23T08:10:19.507703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:12:07.791338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":2534,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.897968+0000","last_change":"2024-01-23T07:46:17.147281+0000","last_active":"2024-01-23T08:10:20.897968+0000","last_peered":"2024-01-23T08:10:20.897968+0000","last_clean":"2024-01-23T08:10:20.897968+0000","last_became_active":"2024-01-23T07:46:17.141733+0000","last_became_peered":"2024-01-23T07:46:17.141733+0000","last_unstale":"2024-01-23T08:10:20.897968+0000","last_undegraded":"2024-01-23T08:10:20.897968+0000","last_fullsized":"2024-01-23T08:10:20.897968+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:14:19.035625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":2521,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.495914+0000","last_change":"2024-01-23T07:35:11.695684+0000","last_active":"2024-01-23T08:10:19.495914+0000","last_peered":"2024-01-23T08:10:19.495914+0000","last_clean":"2024-01-23T08:10:19.495914+0000","last_became_active":"2024-01-23T07:35:11.686621+0000","last_became_peered":"2024-01-23T07:35:11.686621+0000","last_unstale":"2024-01-23T08:10:19.495914+0000","last_undegraded":"2024-01-23T08:10:19.495914+0000","last_fullsized":"2024-01-23T08:10:19.495914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:21:41.433898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":2528,"reported_epoch":1320,"state":"active+clean","last_fresh":"2024-01-23T08:10:21.871152+0000","last_change":"2024-01-23T07:35:52.897767+0000","last_active":"2024-01-23T08:10:21.871152+0000","last_peered":"2024-01-23T08:10:21.871152+0000","last_clean":"2024-01-23T08:10:21.871152+0000","last_became_active":"2024-01-23T07:35:52.882762+0000","last_became_peered":"2024-01-23T07:35:52.882762+0000","last_unstale":"2024-01-23T08:10:21.871152+0000","last_undegraded":"2024-01-23T08:10:21.871152+0000","last_fullsized":"2024-01-23T08:10:21.871152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:43:06.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":2514,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.552708+0000","last_change":"2024-01-23T07:35:31.951915+0000","last_active":"2024-01-23T08:10:19.552708+0000","last_peered":"2024-01-23T08:10:19.552708+0000","last_clean":"2024-01-23T08:10:19.552708+0000","last_became_active":"2024-01-23T07:35:31.935370+0000","last_became_peered":"2024-01-23T07:35:31.935370+0000","last_unstale":"2024-01-23T08:10:19.552708+0000","last_undegraded":"2024-01-23T08:10:19.552708+0000","last_fullsized":"2024-01-23T08:10:19.552708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T07:42:47.447343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":2535,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.882381+0000","last_change":"2024-01-23T07:46:17.160020+0000","last_active":"2024-01-23T08:10:20.882381+0000","last_peered":"2024-01-23T08:10:20.882381+0000","last_clean":"2024-01-23T08:10:20.882381+0000","last_became_active":"2024-01-23T07:46:17.153624+0000","last_became_peered":"2024-01-23T07:46:17.153624+0000","last_unstale":"2024-01-23T08:10:20.882381+0000","last_undegraded":"2024-01-23T08:10:20.882381+0000","last_fullsized":"2024-01-23T08:10:20.882381+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T07:45:27.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":2515,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.558978+0000","last_change":"2024-01-23T07:35:55.640548+0000","last_active":"2024-01-23T08:10:19.558978+0000","last_peered":"2024-01-23T08:10:19.558978+0000","last_clean":"2024-01-23T08:10:19.558978+0000","last_became_active":"2024-01-23T07:35:55.634625+0000","last_became_peered":"2024-01-23T07:35:55.634625+0000","last_unstale":"2024-01-23T08:10:19.558978+0000","last_undegraded":"2024-01-23T08:10:19.558978+0000","last_fullsized":"2024-01-23T08:10:19.558978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:59:35.575710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":2536,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.874291+0000","last_change":"2024-01-23T07:46:17.111555+0000","last_active":"2024-01-23T08:10:20.874291+0000","last_peered":"2024-01-23T08:10:20.874291+0000","last_clean":"2024-01-23T08:10:20.874291+0000","last_became_active":"2024-01-23T07:46:17.105960+0000","last_became_peered":"2024-01-23T07:46:17.105960+0000","last_unstale":"2024-01-23T08:10:20.874291+0000","last_undegraded":"2024-01-23T08:10:20.874291+0000","last_fullsized":"2024-01-23T08:10:20.874291+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:36:28.032265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":19,"seq":81604379072,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72088,"kb_used_data":4800,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299752,"statfs":{"total":96636764160,"available":96562946048,"internally_reserved":0,"allocated":4915200,"data_stored":2237581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":13.061,"5min":24.649999999999999,"15min":18.510999999999999},"min":{"1min":4.6820000000000004,"5min":4.6390000000000002,"15min":4.4500000000000002},"max":{"1min":40.679000000000002,"5min":226.16999999999999,"15min":259.17200000000003},"last":13.391999999999999},{"interface":"front","average":{"1min":13.103,"5min":27.594000000000001,"15min":20.172000000000001},"min":{"1min":5.3700000000000001,"5min":4.5830000000000002,"15min":4.5800000000000001},"max":{"1min":32.253999999999998,"5min":335.11099999999999,"15min":335.11099999999999},"last":10.34}]},{"osd":1,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":11.526999999999999,"5min":25.579000000000001,"15min":20.094999999999999},"min":{"1min":4.7089999999999996,"5min":4.7089999999999996,"15min":4.7089999999999996},"max":{"1min":35.301000000000002,"5min":202.30000000000001,"15min":202.30000000000001},"last":9.2880000000000003},{"interface":"front","average":{"1min":17.094999999999999,"5min":27.420999999999999,"15min":23.341999999999999},"min":{"1min":7.7770000000000001,"5min":7.0030000000000001,"15min":6.8550000000000004},"max":{"1min":46.988999999999997,"5min":129.023,"15min":213.935},"last":9.5630000000000006}]},{"osd":2,"last update":"Tue Jan 23 08:10:18 2024","interfaces":[{"interface":"back","average":{"1min":17.052,"5min":41.604999999999997,"15min":31.245999999999999},"min":{"1min":7.8029999999999999,"5min":6.6710000000000003,"15min":6.5270000000000001},"max":{"1min":30.015999999999998,"5min":689.02099999999996,"15min":689.02099999999996},"last":25.832000000000001},{"interface":"front","average":{"1min":15.247999999999999,"5min":30.026,"15min":27.16},"min":{"1min":8.3960000000000008,"5min":6.556,"15min":6.556},"max":{"1min":26.483000000000001,"5min":363.96699999999998,"15min":386.762},"last":8.2439999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":20.992999999999999,"5min":25.806999999999999,"15min":24.355},"min":{"1min":10.17,"5min":7.8150000000000004,"15min":7.8150000000000004},"max":{"1min":59.957000000000001,"5min":172.78299999999999,"15min":289.80599999999998},"last":11.805},{"interface":"front","average":{"1min":22.202999999999999,"5min":29.404,"15min":28.827999999999999},"min":{"1min":10.856999999999999,"5min":9.9879999999999995,"15min":9.5510000000000002},"max":{"1min":60.607999999999997,"5min":177.40000000000001,"15min":307.245},"last":26.818000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":20.713000000000001,"5min":28.288,"15min":28.074000000000002},"min":{"1min":6.8029999999999999,"5min":6.8029999999999999,"15min":6.8029999999999999},"max":{"1min":44.375,"5min":201.06200000000001,"15min":359.69900000000001},"last":21.858000000000001},{"interface":"front","average":{"1min":23.881,"5min":28.484999999999999,"15min":28.401},"min":{"1min":12.388999999999999,"5min":10.301,"15min":9.407},"max":{"1min":79.674000000000007,"5min":149.059,"15min":334.642},"last":23.311}]},{"osd":6,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":23.018999999999998,"5min":32.515999999999998,"15min":32.387999999999998},"min":{"1min":10.845000000000001,"5min":8.4260000000000002,"15min":8.4260000000000002},"max":{"1min":73.620999999999995,"5min":199.66399999999999,"15min":341.05700000000002},"last":27.483000000000001},{"interface":"front","average":{"1min":29.157,"5min":34.218000000000004,"15min":29.725000000000001},"min":{"1min":15.654,"5min":11.496,"15min":6.6390000000000002},"max":{"1min":101.759,"5min":162.982,"15min":334.94600000000003},"last":28.372}]},{"osd":7,"last update":"Tue Jan 23 08:09:55 2024","interfaces":[{"interface":"back","average":{"1min":14.962999999999999,"5min":23.611000000000001,"15min":25.231000000000002},"min":{"1min":7.3460000000000001,"5min":7.298,"15min":7.2309999999999999},"max":{"1min":63.154000000000003,"5min":191.524,"15min":223.053},"last":12.481},{"interface":"front","average":{"1min":25.978000000000002,"5min":33.332000000000001,"15min":25.420000000000002},"min":{"1min":9.9719999999999995,"5min":8.4459999999999997,"15min":6.9189999999999996},"max":{"1min":99.994,"5min":211.773,"15min":281.75299999999999},"last":26.501000000000001}]}]},{"osd":1,"up_from":19,"seq":81604379071,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72468,"kb_used_data":5188,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299372,"statfs":{"total":96636764160,"available":96562556928,"internally_reserved":0,"allocated":5312512,"data_stored":2635416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:24 2024","interfaces":[{"interface":"back","average":{"1min":10.567,"5min":20.952000000000002,"15min":19.978999999999999},"min":{"1min":6.4989999999999997,"5min":5.4100000000000001,"15min":5.4100000000000001},"max":{"1min":24.219999999999999,"5min":174.22800000000001,"15min":244.16},"last":20.184999999999999},{"interface":"front","average":{"1min":17.425999999999998,"5min":27.312000000000001,"15min":28.744},"min":{"1min":8.5009999999999994,"5min":6.7830000000000004,"15min":6.7830000000000004},"max":{"1min":38.683,"5min":198.155,"15min":260.27800000000002},"last":20.760999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:09:32 2024","interfaces":[{"interface":"back","average":{"1min":15.324,"5min":25.154,"15min":25.584},"min":{"1min":8.266,"5min":8.266,"15min":6.2699999999999996},"max":{"1min":33.029000000000003,"5min":207.15100000000001,"15min":243.33000000000001},"last":29.283000000000001},{"interface":"front","average":{"1min":10.833,"5min":18.463000000000001,"15min":25.510999999999999},"min":{"1min":5.6710000000000003,"5min":4.915,"15min":4.915},"max":{"1min":19.279,"5min":167.71199999999999,"15min":366.99700000000001},"last":31.012}]},{"osd":3,"last update":"Tue Jan 23 08:09:46 2024","interfaces":[{"interface":"back","average":{"1min":21.405999999999999,"5min":28.048999999999999,"15min":23.024000000000001},"min":{"1min":8.6920000000000002,"5min":6.0270000000000001,"15min":5.3650000000000002},"max":{"1min":100.602,"5min":291.79300000000001,"15min":291.79300000000001},"last":13.76},{"interface":"front","average":{"1min":21.239000000000001,"5min":20.696000000000002,"15min":25.032},"min":{"1min":6.1360000000000001,"5min":5.3289999999999997,"15min":5.3289999999999997},"max":{"1min":88.227999999999994,"5min":221.50899999999999,"15min":398.98599999999999},"last":17.399000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":23.504999999999999,"5min":30.498000000000001,"15min":32.963000000000001},"min":{"1min":11.525,"5min":8.2940000000000005,"15min":7.641},"max":{"1min":36.862000000000002,"5min":204.095,"15min":572.26999999999998},"last":16.757000000000001},{"interface":"front","average":{"1min":12.919,"5min":16.268999999999998,"15min":20.911000000000001},"min":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"max":{"1min":40.198,"5min":78.813000000000002,"15min":411.84399999999999},"last":12.363}]},{"osd":5,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":29.154,"5min":28.667000000000002,"15min":31.228000000000002},"min":{"1min":7.6900000000000004,"5min":7.6900000000000004,"15min":7.6900000000000004},"max":{"1min":106.607,"5min":168.93000000000001,"15min":376.55700000000002},"last":13.143000000000001},{"interface":"front","average":{"1min":29.056000000000001,"5min":26.309999999999999,"15min":27.195},"min":{"1min":7.7670000000000003,"5min":7.7670000000000003,"15min":6.3959999999999999},"max":{"1min":91.256,"5min":173.46899999999999,"15min":364.32600000000002},"last":18.881}]},{"osd":6,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":25.513999999999999,"5min":31.672000000000001,"15min":34.091000000000001},"min":{"1min":15.657999999999999,"5min":10.664,"15min":10.664},"max":{"1min":53.466000000000001,"5min":174.54400000000001,"15min":377.375},"last":19.477},{"interface":"front","average":{"1min":22.515000000000001,"5min":26.417999999999999,"15min":26.864000000000001},"min":{"1min":9.1940000000000008,"5min":7.0590000000000002,"15min":7.0590000000000002},"max":{"1min":93.706999999999994,"5min":176.499,"15min":248.40000000000001},"last":14.324999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":21.986000000000001,"5min":26.722999999999999,"15min":22.699999999999999},"min":{"1min":9.6899999999999995,"5min":6.8049999999999997,"15min":6.8049999999999997},"max":{"1min":95.328000000000003,"5min":309.55900000000003,"15min":309.55900000000003},"last":15.849},{"interface":"front","average":{"1min":24.766999999999999,"5min":30.609999999999999,"15min":27.841000000000001},"min":{"1min":11.859999999999999,"5min":11.134,"15min":8.3670000000000009},"max":{"1min":98.653000000000006,"5min":169.82300000000001,"15min":245.946},"last":22.257000000000001}]}]},{"osd":4,"up_from":18,"seq":77309411776,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76264,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295576,"statfs":{"total":96636764160,"available":96558669824,"internally_reserved":0,"allocated":4939776,"data_stored":2252311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":14.598000000000001,"5min":23.437999999999999,"15min":22.77},"min":{"1min":5.8570000000000002,"5min":5.2850000000000001,"15min":5.2850000000000001},"max":{"1min":98.227999999999994,"5min":371.233,"15min":371.233},"last":13.999000000000001},{"interface":"front","average":{"1min":18.530999999999999,"5min":24.696000000000002,"15min":25.018000000000001},"min":{"1min":7.8490000000000002,"5min":6.1909999999999998,"15min":5.9210000000000003},"max":{"1min":106.56699999999999,"5min":244.11199999999999,"15min":351.55700000000002},"last":15.613}]},{"osd":1,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":25.187000000000001,"5min":25.859999999999999,"15min":26.457999999999998},"min":{"1min":8.4510000000000005,"5min":6.3609999999999998,"15min":5.6040000000000001},"max":{"1min":147.08799999999999,"5min":260.22500000000002,"15min":353.72699999999998},"last":14.852},{"interface":"front","average":{"1min":28.363,"5min":33.558,"15min":32.466999999999999},"min":{"1min":12.493,"5min":10.728999999999999,"15min":7.5830000000000002},"max":{"1min":149.196,"5min":271.54700000000003,"15min":352.48700000000002},"last":18.957999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:09:27 2024","interfaces":[{"interface":"back","average":{"1min":13.788,"5min":47.954999999999998,"15min":30.994},"min":{"1min":5.3090000000000002,"5min":4.5800000000000001,"15min":4.5800000000000001},"max":{"1min":103.143,"5min":2731.4580000000001,"15min":2731.4580000000001},"last":6.9320000000000004},{"interface":"front","average":{"1min":16.902999999999999,"5min":42.124000000000002,"15min":27.620000000000001},"min":{"1min":6.7999999999999998,"5min":6.0640000000000001,"15min":4.6040000000000001},"max":{"1min":75.646000000000001,"5min":1368.422,"15min":1368.422},"last":10.259}]},{"osd":3,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":14.923,"5min":21.501000000000001,"15min":27.437000000000001},"min":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"max":{"1min":92.784999999999997,"5min":185.97900000000001,"15min":367.24000000000001},"last":9.3520000000000003},{"interface":"front","average":{"1min":21.876999999999999,"5min":30.088999999999999,"15min":28.812000000000001},"min":{"1min":12.944000000000001,"5min":10.311,"15min":6.4779999999999998},"max":{"1min":109.018,"5min":502.47000000000003,"15min":502.47000000000003},"last":16.41}]},{"osd":5,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":18.542000000000002,"5min":19.931000000000001,"15min":22.861999999999998},"min":{"1min":5.859,"5min":5.859,"15min":5.859},"max":{"1min":92.823999999999998,"5min":109.624,"15min":482.44299999999998},"last":8.0310000000000006},{"interface":"front","average":{"1min":20.876000000000001,"5min":25.094000000000001,"15min":23.469000000000001},"min":{"1min":8.7230000000000008,"5min":6.1280000000000001,"15min":5.3170000000000002},"max":{"1min":108.36499999999999,"5min":227.20500000000001,"15min":339.04300000000001},"last":12.863}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.561,"5min":25.599,"15min":28.395},"min":{"1min":9.6229999999999993,"5min":7.8109999999999999,"15min":7.8109999999999999},"max":{"1min":110.756,"5min":300.51999999999998,"15min":353.113},"last":12.180999999999999},{"interface":"front","average":{"1min":23.277000000000001,"5min":28.373000000000001,"15min":27.132000000000001},"min":{"1min":12.647,"5min":10.74,"15min":6.8090000000000002},"max":{"1min":109.562,"5min":208.05699999999999,"15min":349.64499999999998},"last":17.225999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":26.695,"5min":34.959000000000003,"15min":32.031999999999996},"min":{"1min":15.186,"5min":7.7939999999999996,"15min":7.3719999999999999},"max":{"1min":116.116,"5min":275.20999999999998,"15min":395.82299999999998},"last":18.023},{"interface":"front","average":{"1min":26.236000000000001,"5min":35.244,"15min":32.054000000000002},"min":{"1min":16.350999999999999,"5min":12.57,"15min":6.4859999999999998},"max":{"1min":124.672,"5min":184.47499999999999,"15min":438.92000000000002},"last":19.739999999999998}]}]},{"osd":7,"up_from":473,"seq":2031519531439,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72080,"kb_used_data":4796,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299760,"statfs":{"total":96636764160,"available":96562954240,"internally_reserved":0,"allocated":4911104,"data_stored":2237576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":10.305999999999999,"5min":22.015000000000001,"15min":16.207999999999998},"min":{"1min":5.8280000000000003,"5min":5.6550000000000002,"15min":4.9550000000000001},"max":{"1min":24.335000000000001,"5min":282.28800000000001,"15min":282.28800000000001},"last":5.5759999999999996},{"interface":"front","average":{"1min":18.126999999999999,"5min":28.951000000000001,"15min":22.047000000000001},"min":{"1min":8.6720000000000006,"5min":7.4989999999999997,"15min":5.476},"max":{"1min":48.290999999999997,"5min":285.887,"15min":285.887},"last":8.3949999999999996}]},{"osd":1,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":15.558999999999999,"5min":18.123999999999999,"15min":18.305},"min":{"1min":6.7359999999999998,"5min":4.8440000000000003,"15min":4.6509999999999998},"max":{"1min":74.322999999999993,"5min":162.80500000000001,"15min":199.09399999999999},"last":9.2300000000000004},{"interface":"front","average":{"1min":15.768000000000001,"5min":25.341999999999999,"15min":22.677},"min":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.1550000000000002},"max":{"1min":86.662000000000006,"5min":238.892,"15min":280.24299999999999},"last":10.464}]},{"osd":2,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.838000000000001,"5min":37.078000000000003,"15min":25.183},"min":{"1min":10.106999999999999,"5min":6.8150000000000004,"15min":5.8129999999999997},"max":{"1min":38.683,"5min":1088.116,"15min":1088.116},"last":18.138999999999999},{"interface":"front","average":{"1min":14.474,"5min":35.444000000000003,"15min":25.821000000000002},"min":{"1min":8.9239999999999995,"5min":6.9080000000000004,"15min":5.2699999999999996},"max":{"1min":34.753,"5min":1187.3219999999999,"15min":1187.3219999999999},"last":12.132999999999999}]},{"osd":3,"last update":"Tue Jan 23 08:10:15 2024","interfaces":[{"interface":"back","average":{"1min":19.507000000000001,"5min":23.98,"15min":22.635999999999999},"min":{"1min":8.1560000000000006,"5min":7.7309999999999999,"15min":6.1749999999999998},"max":{"1min":65.203999999999994,"5min":177.09700000000001,"15min":313.31099999999998},"last":13.205},{"interface":"front","average":{"1min":24.954999999999998,"5min":25.353000000000002,"15min":23.792000000000002},"min":{"1min":9.6549999999999994,"5min":6.3029999999999999,"15min":6.3029999999999999},"max":{"1min":84.671999999999997,"5min":179.13999999999999,"15min":228.626},"last":15.894}]},{"osd":4,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.268000000000001,"5min":25.036000000000001,"15min":23.661000000000001},"min":{"1min":7.444,"5min":6.5149999999999997,"15min":6.4850000000000003},"max":{"1min":64.384,"5min":206.381,"15min":277.70400000000001},"last":11.468999999999999},{"interface":"front","average":{"1min":19.050999999999998,"5min":24.832999999999998,"15min":23.053000000000001},"min":{"1min":10.968,"5min":7.7930000000000001,"15min":7.7930000000000001},"max":{"1min":34.298999999999999,"5min":186.768,"15min":320.26799999999997},"last":16.795000000000002}]},{"osd":5,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":18.742999999999999,"5min":29.033999999999999,"15min":25.672999999999998},"min":{"1min":8.7370000000000001,"5min":8.6809999999999992,"15min":8.0350000000000001},"max":{"1min":29.145,"5min":323.63400000000001,"15min":323.63400000000001},"last":17.513999999999999},{"interface":"front","average":{"1min":20.257000000000001,"5min":29.279,"15min":26.036000000000001},"min":{"1min":6.5529999999999999,"5min":6.5529999999999999,"15min":6.5529999999999999},"max":{"1min":69.991,"5min":263.19799999999998,"15min":263.19799999999998},"last":13.912000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":16.844000000000001,"5min":26.978999999999999,"15min":25.648},"min":{"1min":8.0589999999999993,"5min":7.8849999999999998,"15min":7.1449999999999996},"max":{"1min":36.491,"5min":232.35599999999999,"15min":232.35599999999999},"last":14.664},{"interface":"front","average":{"1min":19.102,"5min":30.035,"15min":26.268000000000001},"min":{"1min":10.395,"5min":7.8029999999999999,"15min":7.4320000000000004},"max":{"1min":29.07,"5min":283.27800000000002,"15min":435.91899999999998},"last":19.350999999999999}]}]},{"osd":2,"up_from":16,"seq":68719477171,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72048,"kb_used_data":4772,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299792,"statfs":{"total":96636764160,"available":96562987008,"internally_reserved":0,"allocated":4886528,"data_stored":2221793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":8.8000000000000007,"5min":27.609999999999999,"15min":18.635999999999999},"min":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"max":{"1min":21.404,"5min":1085.3969999999999,"15min":1085.3969999999999},"last":21.388000000000002},{"interface":"front","average":{"1min":12.24,"5min":32.030000000000001,"15min":23.178000000000001},"min":{"1min":6.7759999999999998,"5min":5.093,"15min":4.5380000000000003},"max":{"1min":20.372,"5min":938.18899999999996,"15min":938.18899999999996},"last":6.9249999999999998}]},{"osd":1,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":11.996,"5min":22.428999999999998,"15min":22.510999999999999},"min":{"1min":7.5,"5min":5.2000000000000002,"15min":5.0389999999999997},"max":{"1min":27.957000000000001,"5min":281.33499999999998,"15min":310.05200000000002},"last":7.8879999999999999},{"interface":"front","average":{"1min":16.562999999999999,"5min":38.578000000000003,"15min":32.250999999999998},"min":{"1min":8.6110000000000007,"5min":6.2220000000000004,"15min":6.2220000000000004},"max":{"1min":27.175999999999998,"5min":969.31899999999996,"15min":969.31899999999996},"last":27.952000000000002}]},{"osd":3,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":16.364000000000001,"5min":35.424999999999997,"15min":28.559999999999999},"min":{"1min":6.5270000000000001,"5min":6.5270000000000001,"15min":5.9909999999999997},"max":{"1min":79.376000000000005,"5min":1096.0550000000001,"15min":1096.0550000000001},"last":8.5879999999999992},{"interface":"front","average":{"1min":20.065000000000001,"5min":37.469999999999999,"15min":30.396999999999998},"min":{"1min":9.1189999999999998,"5min":8.782,"15min":8.1910000000000007},"max":{"1min":81.116,"5min":1097.8199999999999,"15min":1097.8199999999999},"last":22.763999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":16.434999999999999,"5min":29.039999999999999,"15min":27.286000000000001},"min":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":6.742},"max":{"1min":78.128,"5min":454.44299999999998,"15min":454.44299999999998},"last":22.082999999999998},{"interface":"front","average":{"1min":16.774000000000001,"5min":34.783000000000001,"15min":29.050000000000001},"min":{"1min":8.423,"5min":8.423,"15min":7.5380000000000003},"max":{"1min":25.576000000000001,"5min":1087.472,"15min":1087.472},"last":20.690999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":14.894,"5min":28.713999999999999,"15min":24.637},"min":{"1min":8.1760000000000002,"5min":8.0719999999999992,"15min":8.0719999999999992},"max":{"1min":24.890000000000001,"5min":455.05500000000001,"15min":455.05500000000001},"last":28.541},{"interface":"front","average":{"1min":17.791,"5min":34.188000000000002,"15min":29.135999999999999},"min":{"1min":9.9220000000000006,"5min":9.9220000000000006,"15min":9.1500000000000004},"max":{"1min":28.599,"5min":455.66699999999997,"15min":455.66699999999997},"last":33.380000000000003}]},{"osd":6,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":17.425000000000001,"5min":40.386000000000003,"15min":29.199000000000002},"min":{"1min":9.6199999999999992,"5min":7.6719999999999997,"15min":7.6189999999999998},"max":{"1min":29.992000000000001,"5min":977.35299999999995,"15min":977.35299999999995},"last":27.268999999999998},{"interface":"front","average":{"1min":20.593,"5min":44.506,"15min":32.329000000000001},"min":{"1min":9.0060000000000002,"5min":9.0060000000000002,"15min":9.0060000000000002},"max":{"1min":30.98,"5min":982.83100000000002,"15min":982.83100000000002},"last":31.09}]},{"osd":7,"last update":"Tue Jan 23 08:10:04 2024","interfaces":[{"interface":"back","average":{"1min":27.013000000000002,"5min":50.5,"15min":33.725999999999999},"min":{"1min":11.968,"5min":10.092000000000001,"15min":8.9199999999999999},"max":{"1min":149.69399999999999,"5min":979.63699999999994,"15min":979.63699999999994},"last":19.434000000000001},{"interface":"front","average":{"1min":35.767000000000003,"5min":57.726999999999997,"15min":38.661000000000001},"min":{"1min":15.068,"5min":10.776999999999999,"15min":8.4049999999999994},"max":{"1min":156.78100000000001,"5min":984.54899999999998,"15min":984.54899999999998},"last":32.543999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542589,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72072,"kb_used_data":4796,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299768,"statfs":{"total":96636764160,"available":96562962432,"internally_reserved":0,"allocated":4911104,"data_stored":2237576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":14.076000000000001,"5min":26.460000000000001,"15min":18.937999999999999},"min":{"1min":5.5800000000000001,"5min":5.4349999999999996,"15min":4.6289999999999996},"max":{"1min":58.256999999999998,"5min":240.86000000000001,"15min":259.21699999999998},"last":15.618},{"interface":"front","average":{"1min":20.256,"5min":34.912999999999997,"15min":22.837},"min":{"1min":10.065,"5min":8.3789999999999996,"15min":4.3719999999999999},"max":{"1min":85.894000000000005,"5min":241.94999999999999,"15min":241.94999999999999},"last":19.550000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:09:29 2024","interfaces":[{"interface":"back","average":{"1min":10.087999999999999,"5min":30.771999999999998,"15min":22.111000000000001},"min":{"1min":5.6349999999999998,"5min":5.6349999999999998,"15min":4.8499999999999996},"max":{"1min":22.939,"5min":272.22300000000001,"15min":272.22300000000001},"last":30.334},{"interface":"front","average":{"1min":20.882000000000001,"5min":41.527000000000001,"15min":27.675000000000001},"min":{"1min":10.710000000000001,"5min":8.9939999999999998,"15min":5.8470000000000004},"max":{"1min":37.408999999999999,"5min":272.08100000000002,"15min":328.67500000000001},"last":35.152000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":20.913,"5min":32.823999999999998,"15min":23.902000000000001},"min":{"1min":9.9969999999999999,"5min":6.7539999999999996,"15min":6.7539999999999996},"max":{"1min":40.466999999999999,"5min":205.28700000000001,"15min":205.28700000000001},"last":14.095000000000001},{"interface":"front","average":{"1min":13.377000000000001,"5min":27.677,"15min":21.324000000000002},"min":{"1min":7.2839999999999998,"5min":6.2450000000000001,"15min":6.2450000000000001},"max":{"1min":41.201999999999998,"5min":205.19499999999999,"15min":205.19499999999999},"last":10.047000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.251999999999999,"5min":31.273,"15min":23.646000000000001},"min":{"1min":9.9580000000000002,"5min":7.835,"15min":6.6689999999999996},"max":{"1min":35.313000000000002,"5min":270.214,"15min":270.214},"last":7.8310000000000004},{"interface":"front","average":{"1min":12.816000000000001,"5min":24.617000000000001,"15min":19.789999999999999},"min":{"1min":6.8490000000000002,"5min":6.4409999999999998,"15min":6.0579999999999998},"max":{"1min":27.478999999999999,"5min":206.066,"15min":206.066},"last":7.1959999999999997}]},{"osd":5,"last update":"Tue Jan 23 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":23.785,"5min":39.161000000000001,"15min":28.478000000000002},"min":{"1min":14.23,"5min":10.859,"15min":7.3689999999999998},"max":{"1min":83.944000000000003,"5min":266.38900000000001,"15min":269.887},"last":11.551},{"interface":"front","average":{"1min":17.472999999999999,"5min":25.440999999999999,"15min":22.010999999999999},"min":{"1min":8.0150000000000006,"5min":6.5090000000000003,"15min":5.431},"max":{"1min":76.481999999999999,"5min":267.16199999999998,"15min":267.16199999999998},"last":8.5350000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.571000000000002,"5min":35.337000000000003,"15min":28.390000000000001},"min":{"1min":8.4410000000000007,"5min":8.4410000000000007,"15min":8.2970000000000006},"max":{"1min":38.991,"5min":306.05900000000003,"15min":306.05900000000003},"last":15.032},{"interface":"front","average":{"1min":16.009,"5min":29.239000000000001,"15min":25.030000000000001},"min":{"1min":7.5499999999999998,"5min":7.2149999999999999,"15min":7.2149999999999999},"max":{"1min":38.191000000000003,"5min":235.76599999999999,"15min":235.76599999999999},"last":9.4459999999999997}]},{"osd":7,"last update":"Tue Jan 23 08:10:00 2024","interfaces":[{"interface":"back","average":{"1min":22.579999999999998,"5min":41,"15min":28.344999999999999},"min":{"1min":15.906000000000001,"5min":12.061,"15min":6.9009999999999998},"max":{"1min":39.82,"5min":234.15700000000001,"15min":234.15700000000001},"last":13.494},{"interface":"front","average":{"1min":16.991,"5min":31.675999999999998,"15min":25.094999999999999},"min":{"1min":9.718,"5min":8.4979999999999993,"15min":6.6929999999999996},"max":{"1min":30.414999999999999,"5min":239.101,"15min":246.71799999999999},"last":12.375999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72112,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299728,"statfs":{"total":96636764160,"available":96562921472,"internally_reserved":0,"allocated":4952064,"data_stored":2259859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.843,"5min":21.023,"15min":20.405999999999999},"min":{"1min":6.4370000000000003,"5min":5.6959999999999997,"15min":4.5039999999999996},"max":{"1min":27.398,"5min":168.251,"15min":312.25599999999997},"last":12.209},{"interface":"front","average":{"1min":16.335999999999999,"5min":31.129999999999999,"15min":26.777000000000001},"min":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":5.2380000000000004},"max":{"1min":30.542000000000002,"5min":253.14500000000001,"15min":312.85199999999998},"last":18.143000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.454999999999998,"5min":20.600000000000001,"15min":21.294},"min":{"1min":6.4470000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"max":{"1min":72.905000000000001,"5min":174.38800000000001,"15min":310.94200000000001},"last":17.215},{"interface":"front","average":{"1min":11.943,"5min":19.451000000000001,"15min":24.952999999999999},"min":{"1min":6.5999999999999996,"5min":5.8339999999999996,"15min":5.8339999999999996},"max":{"1min":40.143999999999998,"5min":208.99199999999999,"15min":285.43599999999998},"last":5.8979999999999997}]},{"osd":2,"last update":"Tue Jan 23 08:10:22 2024","interfaces":[{"interface":"back","average":{"1min":15.574,"5min":44.034999999999997,"15min":27.588000000000001},"min":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"max":{"1min":73.838999999999999,"5min":1676.316,"15min":1676.316},"last":10.285},{"interface":"front","average":{"1min":20.335999999999999,"5min":48.231999999999999,"15min":32.299999999999997},"min":{"1min":10.959,"5min":6.6260000000000003,"15min":6.6260000000000003},"max":{"1min":75.010000000000005,"5min":1582.598,"15min":1582.598},"last":14.573}]},{"osd":3,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.201000000000001,"5min":25.422000000000001,"15min":24.648},"min":{"1min":10.119999999999999,"5min":10.119999999999999,"15min":7.8049999999999997},"max":{"1min":33.652000000000001,"5min":138.828,"15min":311.21300000000002},"last":19.074000000000002},{"interface":"front","average":{"1min":20.939,"5min":27.923999999999999,"15min":28.23},"min":{"1min":12.728999999999999,"5min":10.895,"15min":10.42},"max":{"1min":34.484999999999999,"5min":180.071,"15min":313.44200000000001},"last":21.084}]},{"osd":4,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.15,"5min":17.157,"15min":17.864000000000001},"min":{"1min":5.282,"5min":5.2320000000000002,"15min":5.2320000000000002},"max":{"1min":31.683,"5min":163.13399999999999,"15min":355.80000000000001},"last":7.5279999999999996},{"interface":"front","average":{"1min":16.738,"5min":23.565000000000001,"15min":23.312000000000001},"min":{"1min":9.1180000000000003,"5min":6.9829999999999997,"15min":6.9829999999999997},"max":{"1min":29.797999999999998,"5min":172.30799999999999,"15min":331.42500000000001},"last":15.335000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:09:39 2024","interfaces":[{"interface":"back","average":{"1min":23.756,"5min":28.641999999999999,"15min":26.856000000000002},"min":{"1min":8.8849999999999998,"5min":8.5679999999999996,"15min":7.8380000000000001},"max":{"1min":63.781999999999996,"5min":248.00899999999999,"15min":259.23200000000003},"last":27.103000000000002},{"interface":"front","average":{"1min":28.175000000000001,"5min":34.142000000000003,"15min":31.850999999999999},"min":{"1min":15.789999999999999,"5min":9.7319999999999993,"15min":9.7319999999999993},"max":{"1min":79.778999999999996,"5min":249.30099999999999,"15min":278.38400000000001},"last":31.632999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:17 2024","interfaces":[{"interface":"back","average":{"1min":12.960000000000001,"5min":20.105,"15min":21.783999999999999},"min":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1769999999999996},"max":{"1min":38.274000000000001,"5min":167.12100000000001,"15min":343.786},"last":11.462},{"interface":"front","average":{"1min":20.988,"5min":31.399999999999999,"15min":29.193999999999999},"min":{"1min":10.363,"5min":10.363,"15min":10.363},"max":{"1min":68.890000000000001,"5min":186.30199999999999,"15min":302.589},"last":16.449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575295,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72520,"kb_used_data":5240,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299320,"statfs":{"total":96636764160,"available":96562503680,"internally_reserved":0,"allocated":5365760,"data_stored":2664419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":11.755000000000001,"5min":15.83,"15min":17.065000000000001},"min":{"1min":5.0640000000000001,"5min":4.3899999999999997,"15min":4.3849999999999998},"max":{"1min":31.181000000000001,"5min":107.895,"15min":301.08300000000003},"last":8.2520000000000007},{"interface":"front","average":{"1min":13.680999999999999,"5min":15.866,"15min":18.422000000000001},"min":{"1min":6.8079999999999998,"5min":4.46,"15min":4.46},"max":{"1min":44.594000000000001,"5min":112.321,"15min":299.28699999999998},"last":9.875}]},{"osd":1,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":18.789999999999999,"5min":16.811,"15min":21.641999999999999},"min":{"1min":7.4450000000000003,"5min":6.0640000000000001,"15min":6.0640000000000001},"max":{"1min":48.829999999999998,"5min":108.367,"15min":335.601},"last":18.927},{"interface":"front","average":{"1min":15.991,"5min":15.215999999999999,"15min":18.478000000000002},"min":{"1min":6.2990000000000004,"5min":6.2990000000000004,"15min":5.9269999999999996},"max":{"1min":35.363,"5min":95.385000000000005,"15min":338.95499999999998},"last":6.8440000000000003}]},{"osd":2,"last update":"Tue Jan 23 08:10:20 2024","interfaces":[{"interface":"back","average":{"1min":15.198,"5min":20.091999999999999,"15min":22.443000000000001},"min":{"1min":6.915,"5min":6.3940000000000001,"15min":6.2859999999999996},"max":{"1min":39.262999999999998,"5min":122.42700000000001,"15min":280.85399999999998},"last":13.233000000000001},{"interface":"front","average":{"1min":15.127000000000001,"5min":20.622,"15min":23.937999999999999},"min":{"1min":7,"5min":6.7720000000000002,"15min":6.7720000000000002},"max":{"1min":66.775000000000006,"5min":268.779,"15min":307.334},"last":11.913}]},{"osd":3,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":16.997,"5min":19.888999999999999,"15min":27.268000000000001},"min":{"1min":7.5330000000000004,"5min":7.2489999999999997,"15min":7.2489999999999997},"max":{"1min":34.234000000000002,"5min":108.986,"15min":412.625},"last":10.535},{"interface":"front","average":{"1min":16.832000000000001,"5min":20.248000000000001,"15min":25.879999999999999},"min":{"1min":7.306,"5min":7.306,"15min":7.1660000000000004},"max":{"1min":46.414999999999999,"5min":115.22499999999999,"15min":253.58199999999999},"last":8.8810000000000002}]},{"osd":4,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":20.035,"5min":20.260000000000002,"15min":23.454999999999998},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":60.408000000000001,"5min":126.482,"15min":224.07400000000001},"last":13.904999999999999},{"interface":"front","average":{"1min":24.856999999999999,"5min":24.849,"15min":27.280999999999999},"min":{"1min":11.863,"5min":9.5809999999999995,"15min":9.5809999999999995},"max":{"1min":68.748000000000005,"5min":175.51599999999999,"15min":281.10399999999998},"last":14.609}]},{"osd":6,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":15.853,"5min":18.908999999999999,"15min":22.780999999999999},"min":{"1min":8.4540000000000006,"5min":7.5039999999999996,"15min":7.1130000000000004},"max":{"1min":36.344999999999999,"5min":141.524,"15min":338.66300000000001},"last":18.085999999999999},{"interface":"front","average":{"1min":22.779,"5min":24.696999999999999,"15min":28.998999999999999},"min":{"1min":13.907999999999999,"5min":11.093,"15min":10.342000000000001},"max":{"1min":72.058000000000007,"5min":145.38300000000001,"15min":417.69},"last":16.792999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":25.297000000000001,"5min":23.457999999999998,"15min":22.731000000000002},"min":{"1min":12.375,"5min":9.8699999999999992,"15min":7.5039999999999996},"max":{"1min":103.679,"5min":111.083,"15min":244.40100000000001},"last":19.776},{"interface":"front","average":{"1min":18.907,"5min":20.039000000000001,"15min":21.625},"min":{"1min":6.3700000000000001,"5min":6.3700000000000001,"15min":6.3700000000000001},"max":{"1min":67.561000000000007,"5min":112.648,"15min":252.24000000000001},"last":11.304}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:10:25.185 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:10:25.285 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.285+0000 7f06c194e640 10 monclient: get_monmap_and_config 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.285+0000 7f06c194e640 10 monclient: build_initial_monmap 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.285+0000 7f06c194e640 10 monclient: monmap: 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:25.286927+0000 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:25.286927+0000 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:25.286 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:25.287 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.290 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.286+0000 7f06c194e640 1 Processor -- start 2024-01-23T08:10:25.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.286+0000 7f06c194e640 1 -- start start 2024-01-23T08:10:25.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.286+0000 7f06c194e640 10 monclient: init 2024-01-23T08:10:25.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:25.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2024-01-23T08:10:25.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f06bc0a96e0 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:25.291 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f06bc13faa0 0x7f06bc0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient(hunting): picked mon.noname-a con 0x7f06bc13faa0 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:25.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f06bc145600 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:25.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06bc0aac10 con 0x7f06bc145600 2024-01-23T08:10:25.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06bc0a9ac0 con 0x7f06bc0a96e0 2024-01-23T08:10:25.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.292 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06bc0a9e00 con 0x7f06bc13faa0 2024-01-23T08:10:25.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:25.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06c194e640 10 monclient(hunting): authenticate will time out at 4632.645358s 2024-01-23T08:10:25.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06baffd640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f06bc0a96e0 0x7f06bc13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:38808/0 (socket says 172.21.15.116:38808) 2024-01-23T08:10:25.293 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.287+0000 7f06baffd640 1 -- 172.21.15.116:0/1287772502 learned_addr learned my addr 172.21.15.116:0/1287772502 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:25.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.288+0000 7f06b3fff640 1 --2- 172.21.15.116:0/1287772502 >> v2:172.21.15.116:3300/0 conn(0x7f06bc13faa0 0x7f06bc0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.288+0000 7f06b3fff640 10 monclient(hunting): get_auth_request con 0x7f06bc13faa0 auth_method 0 2024-01-23T08:10:25.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.288+0000 7f06b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.288+0000 7f06b3fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.294 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.288+0000 7f06b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.289+0000 7f06b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.289+0000 7f06b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.289+0000 7f06b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.290+0000 7f06ba7fc640 1 -- 172.21.15.116:0/1287772502 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568633122 0 0) 0x7f06bc0a9ac0 con 0x7f06bc0a96e0 2024-01-23T08:10:25.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.290+0000 7f06ba7fc640 10 monclient(hunting): _negotiate 2024-01-23T08:10:25.295 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.290+0000 7f06ba7fc640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.290+0000 7f06ba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.290+0000 7f06ba7fc640 10 monclient(hunting): my global_id is 20905 2024-01-23T08:10:25.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.290+0000 7f06ba7fc640 1 -- 172.21.15.116:0/1287772502 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a8003520 con 0x7f06bc0a96e0 2024-01-23T08:10:25.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 10 monclient(hunting): handle_auth_done global_id 16506 payload 274 2024-01-23T08:10:25.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 1 -- 172.21.15.116:0/1287772502 >> v1:172.21.15.173:6789/0 conn(0x7f06bc0a96e0 legacy=0x7f06bc13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 1 -- 172.21.15.116:0/1287772502 >> v1:172.21.15.116:6789/0 conn(0x7f06bc145600 legacy=0x7f06bc145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 10 monclient: _finish_hunting 0 2024-01-23T08:10:25.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 1 monclient: found mon.noname-a 2024-01-23T08:10:25.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:25.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:25.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.292+0000 7f06b3fff640 1 -- 172.21.15.116:0/1287772502 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc0aae80 con 0x7f06bc13faa0 2024-01-23T08:10:25.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.295+0000 7f06b3fff640 1 --2- 172.21.15.116:0/1287772502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc0b1850 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009790 tx=0x7f06a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e375b7acfe3de1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 1 -- 172.21.15.116:0/1287772502 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4030610 con 0x7f06bc13faa0 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: dump: 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.306 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: _finish_auth 0 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: _check_auth_tickets 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 1 -- 172.21.15.116:0/1287772502 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4030770 con 0x7f06bc13faa0 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 1 -- 172.21.15.116:0/1287772502 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4030b00 con 0x7f06bc13faa0 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.307 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06ba7fc640 10 monclient: dump: 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.308 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06c194e640 5 monclient: authenticate success, global_id 16506 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06c194e640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.298+0000 7f06c194e640 4 set_mon_vals no callback set 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 10 monclient: shutdown 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 1 -- 172.21.15.116:0/1287772502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 msgr2=0x7f06bc0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 1 --2- 172.21.15.116:0/1287772502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc0b1850 secure :-1 s=READY pgs=3237 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009790 tx=0x7f06a402b960 comp rx=0 tx=0).stop 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 1 -- 172.21.15.116:0/1287772502 shutdown_connections 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 1 --2- 172.21.15.116:0/1287772502 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc0b1850 unknown :-1 s=CLOSED pgs=3237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 1 -- 172.21.15.116:0/1287772502 >> 172.21.15.116:0/1287772502 conn(0x7f06bc0b7bb0 msgr2=0x7f06bc0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:25.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 1 -- 172.21.15.116:0/1287772502 shutdown_connections 2024-01-23T08:10:25.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.299+0000 7f06c194e640 1 -- 172.21.15.116:0/1287772502 wait complete. 2024-01-23T08:10:25.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 10 monclient: build_initial_monmap 2024-01-23T08:10:25.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 10 monclient: monmap: 2024-01-23T08:10:25.312 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:25.312 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:25.312 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 1 librados: starting msgr at 2024-01-23T08:10:25.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 1 librados: starting objecter 2024-01-23T08:10:25.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 1 Processor -- start 2024-01-23T08:10:25.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 1 -- start start 2024-01-23T08:10:25.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 1 librados: setting wanted keys 2024-01-23T08:10:25.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 1 librados: calling monclient init 2024-01-23T08:10:25.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.300+0000 7f06c194e640 10 monclient: init 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06bc0a96e0 0x7f06bc13c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): picked mon.noname-b con 0x7f06bc0a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): picked mon.noname-a con 0x7f06bc13faa0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06bc145600 0x7f06bc140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): picked mon.noname-c con 0x7f06bc145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:25.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc141c10 con 0x7f06bc13faa0 2024-01-23T08:10:25.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc141e80 con 0x7f06bc0a96e0 2024-01-23T08:10:25.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06bc144dd0 con 0x7f06bc145600 2024-01-23T08:10:25.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:25.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06c194e640 10 monclient(hunting): authenticate will time out at 4632.659404s 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06b3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06baffd640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06bc0a96e0 0x7f06bc13c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06bb7fe640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06bc145600 0x7f06bc140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06b3fff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc140140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:49956/0 (socket says 172.21.15.116:49956) 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06b3fff640 1 -- 172.21.15.116:0/2047699189 learned_addr learned my addr 172.21.15.116:0/2047699189 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06b3fff640 10 monclient(hunting): get_auth_request con 0x7f06bc13faa0 auth_method 0 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06b3fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.301+0000 7f06b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06baffd640 10 monclient(hunting): get_auth_request con 0x7f06bc0a96e0 auth_method 0 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06baffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06baffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06baffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06bb7fe640 10 monclient(hunting): get_auth_request con 0x7f06bc145600 auth_method 0 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06bb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06bb7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06baffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06baffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06baffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06bb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06bb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.302+0000 7f06bb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 10 monclient(hunting): handle_auth_done global_id 20908 payload 824 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 1 -- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06bc145600 msgr2=0x7f06bc140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06bc145600 0x7f06bc140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 1 -- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 msgr2=0x7f06bc140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 10 monclient: _finish_hunting 0 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 1 monclient: found mon.noname-b 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.305+0000 7f06baffd640 1 -- 172.21.15.116:0/2047699189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40093a0 con 0x7f06bc0a96e0 2024-01-23T08:10:25.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.307+0000 7f06baffd640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06bc0a96e0 0x7f06bc13c440 secure :-1 s=READY pgs=5211 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00c400 tx=0x7f06ac00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:25.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.307+0000 7f06b8ff9640 10 client.?.objecter ms_handle_connect 0x7f06bc0a96e0 2024-01-23T08:10:25.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.307+0000 7f06b8ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:25.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 1 -- 172.21.15.116:0/2047699189 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac005ce0 con 0x7f06bc0a96e0 2024-01-23T08:10:25.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:25.321 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: dump: 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.322 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: _finish_auth 0 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: _check_auth_tickets 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 1 -- 172.21.15.116:0/2047699189 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac005e40 con 0x7f06bc0a96e0 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06c194e640 5 monclient: authenticate success, global_id 20908 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:25.323 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 1 -- 172.21.15.116:0/2047699189 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ac0072f0 con 0x7f06bc0a96e0 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06c194e640 10 monclient: _renew_subs 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06c194e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06bc146320 con 0x7f06bc0a96e0 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b8ff9640 10 monclient: dump: 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.324 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.325 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.310+0000 7f06b9ffb640 4 set_mon_vals no callback set 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 10 client.20908.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 10 monclient: _renew_subs 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06bc1422a0 con 0x7f06bc0a96e0 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 1 librados: init done 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:25.326 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.327 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.311+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06bc067d70 con 0x7f06bc0a96e0 2024-01-23T08:10:25.329 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.330+0000 7f06b8ff9640 1 -- 172.21.15.116:0/2047699189 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f06ac007450 con 0x7f06bc0a96e0 2024-01-23T08:10:25.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.330+0000 7f06b8ff9640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f069c06c860 0x7f069c06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.330+0000 7f06b3fff640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f069c06c860 0x7f069c06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.330+0000 7f06b3fff640 10 monclient: get_auth_request con 0x7f069c06c860 auth_method 0 2024-01-23T08:10:25.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.330+0000 7f06b8ff9640 10 client.20908.objecter ms_handle_connect 0x7f069c06c860 2024-01-23T08:10:25.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.330+0000 7f06b3fff640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f069c06c860 0x7f069c06ed20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f06bc1451f0 tx=0x7f06a4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:25.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.332+0000 7f06b8ff9640 1 -- 172.21.15.116:0/2047699189 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1322..1322 src has 1032..1322) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f06ac057f10 con 0x7f06bc0a96e0 2024-01-23T08:10:25.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.332+0000 7f06b8ff9640 10 client.20908.objecter ms_dispatch 0x7f06bc000b90 osd_map(1322..1322 src has 1032..1322) v4 2024-01-23T08:10:25.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.332+0000 7f06b8ff9640 3 client.20908.objecter handle_osd_map got epochs [1322,1322] > 0 2024-01-23T08:10:25.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.332+0000 7f06b8ff9640 3 client.20908.objecter handle_osd_map decoding full epoch 1322 2024-01-23T08:10:25.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.332+0000 7f06b8ff9640 20 client.20908.objecter dump_active .. 0 homeless 2024-01-23T08:10:25.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.565+0000 7f06b8ff9640 1 -- 172.21.15.116:0/2047699189 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f06ac054250 con 0x7f06bc0a96e0 2024-01-23T08:10:25.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.565+0000 7f06b8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:25.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.565+0000 7f06b8ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:25.741 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.741+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06bc1348e0 con 0x7f069c06c860 2024-01-23T08:10:25.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.746+0000 7f06b8ff9640 1 -- 172.21.15.116:0/2047699189 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151851 (secure 0 0 0) 0x7f06bc1348e0 con 0x7f069c06c860 2024-01-23T08:10:25.748 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T08:10:25.748 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-01-23T08:10:25.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.748+0000 7f06c194e640 10 librados: watch_flush enter 2024-01-23T08:10:25.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.748+0000 7f06c194e640 10 librados: watch_flush exit 2024-01-23T08:10:25.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.748+0000 7f06c194e640 20 client.20908.objecter shutdown clearing up homeless session... 2024-01-23T08:10:25.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.748+0000 7f06c194e640 10 client.20908.objecter successfully canceled tick 2024-01-23T08:10:25.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f069c06c860 msgr2=0x7f069c06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f069c06c860 0x7f069c06ed20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f06bc1451f0 tx=0x7f06a4008030 comp rx=0 tx=0).stop 2024-01-23T08:10:25.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 10 monclient: shutdown 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06bc0a96e0 msgr2=0x7f06bc13c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06bc0a96e0 0x7f06bc13c440 secure :-1 s=READY pgs=5211 cs=0 l=1 rev1=1 crypto rx=0x7f06ac00c400 tx=0x7f06ac00c8c0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 shutdown_connections 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f069c06c860 0x7f069c06ed20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f06bc145600 0x7f06bc140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f06bc13faa0 0x7f06bc140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 --2- 172.21.15.116:0/2047699189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f06bc0a96e0 0x7f06bc13c440 unknown :-1 s=CLOSED pgs=5211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 >> 172.21.15.116:0/2047699189 conn(0x7f06bc0b7bb0 msgr2=0x7f06bc0b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 shutdown_connections 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 -- 172.21.15.116:0/2047699189 wait complete. 2024-01-23T08:10:25.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.749+0000 7f06c194e640 1 librados: shutdown 2024-01-23T08:10:25.761 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2440,"stamp":"2024-01-23T08:10:25.070410+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":581652,"kb_used_data":39252,"kb_used_omap":12,"kb_used_meta":542259,"kb_avail":754393068,"statfs":{"total":773094113280,"available":772498501632,"internally_reserved":0,"allocated":40194048,"data_stored":18746531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":555273776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":200,"apply_latency_ms":200,"commit_latency_ns":200000000,"apply_latency_ns":200000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.260333"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":2543,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.918403+0000","last_change":"2024-01-23T07:35:49.772956+0000","last_active":"2024-01-23T08:10:20.918403+0000","last_peered":"2024-01-23T08:10:20.918403+0000","last_clean":"2024-01-23T08:10:20.918403+0000","last_became_active":"2024-01-23T07:35:49.767110+0000","last_became_peered":"2024-01-23T07:35:49.767110+0000","last_unstale":"2024-01-23T08:10:20.918403+0000","last_undegraded":"2024-01-23T08:10:20.918403+0000","last_fullsized":"2024-01-23T08:10:20.918403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:11:19.875803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":2538,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.912573+0000","last_change":"2024-01-23T07:46:17.396184+0000","last_active":"2024-01-23T08:10:20.912573+0000","last_peered":"2024-01-23T08:10:20.912573+0000","last_clean":"2024-01-23T08:10:20.912573+0000","last_became_active":"2024-01-23T07:46:17.386551+0000","last_became_peered":"2024-01-23T07:46:17.386551+0000","last_unstale":"2024-01-23T08:10:20.912573+0000","last_undegraded":"2024-01-23T08:10:20.912573+0000","last_fullsized":"2024-01-23T08:10:20.912573+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:18:07.924980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":2067,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.024512+0000","last_change":"2024-01-23T07:40:37.949256+0000","last_active":"2024-01-23T08:10:23.024512+0000","last_peered":"2024-01-23T08:10:23.024512+0000","last_clean":"2024-01-23T08:10:23.024512+0000","last_became_active":"2024-01-23T07:40:37.943110+0000","last_became_peered":"2024-01-23T07:40:37.943110+0000","last_unstale":"2024-01-23T08:10:23.024512+0000","last_undegraded":"2024-01-23T08:10:23.024512+0000","last_fullsized":"2024-01-23T08:10:23.024512+0000","mapping_epoch":276,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":277,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:47:53.342128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":2524,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.613576+0000","last_change":"2024-01-23T07:35:17.672440+0000","last_active":"2024-01-23T08:10:17.613576+0000","last_peered":"2024-01-23T08:10:17.613576+0000","last_clean":"2024-01-23T08:10:17.613576+0000","last_became_active":"2024-01-23T07:35:17.664344+0000","last_became_peered":"2024-01-23T07:35:17.664344+0000","last_unstale":"2024-01-23T08:10:17.613576+0000","last_undegraded":"2024-01-23T08:10:17.613576+0000","last_fullsized":"2024-01-23T08:10:17.613576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:29:47.794690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.602445+0000","last_change":"2024-01-23T07:35:53.501964+0000","last_active":"2024-01-23T08:10:17.602445+0000","last_peered":"2024-01-23T08:10:17.602445+0000","last_clean":"2024-01-23T08:10:17.602445+0000","last_became_active":"2024-01-23T07:35:53.492743+0000","last_became_peered":"2024-01-23T07:35:53.492743+0000","last_unstale":"2024-01-23T08:10:17.602445+0000","last_undegraded":"2024-01-23T08:10:17.602445+0000","last_fullsized":"2024-01-23T08:10:17.602445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:57:15.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":2533,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.872031+0000","last_change":"2024-01-23T07:46:16.359928+0000","last_active":"2024-01-23T08:10:20.872031+0000","last_peered":"2024-01-23T08:10:20.872031+0000","last_clean":"2024-01-23T08:10:20.872031+0000","last_became_active":"2024-01-23T07:46:16.353670+0000","last_became_peered":"2024-01-23T07:46:16.353670+0000","last_unstale":"2024-01-23T08:10:20.872031+0000","last_undegraded":"2024-01-23T08:10:20.872031+0000","last_fullsized":"2024-01-23T08:10:20.872031+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:55:34.799754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.637288+0000","last_change":"2024-01-23T07:35:17.534265+0000","last_active":"2024-01-23T08:10:17.637288+0000","last_peered":"2024-01-23T08:10:17.637288+0000","last_clean":"2024-01-23T08:10:17.637288+0000","last_became_active":"2024-01-23T07:35:17.521909+0000","last_became_peered":"2024-01-23T07:35:17.521909+0000","last_unstale":"2024-01-23T08:10:17.637288+0000","last_undegraded":"2024-01-23T08:10:17.637288+0000","last_fullsized":"2024-01-23T08:10:17.637288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:42:31.245205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":2525,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.884563+0000","last_change":"2024-01-23T07:46:17.614578+0000","last_active":"2024-01-23T08:10:20.884563+0000","last_peered":"2024-01-23T08:10:20.884563+0000","last_clean":"2024-01-23T08:10:20.884563+0000","last_became_active":"2024-01-23T07:46:17.609277+0000","last_became_peered":"2024-01-23T07:46:17.609277+0000","last_unstale":"2024-01-23T08:10:20.884563+0000","last_undegraded":"2024-01-23T08:10:20.884563+0000","last_fullsized":"2024-01-23T08:10:20.884563+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:04:31.637396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.606279+0000","last_change":"2024-01-23T07:35:17.515370+0000","last_active":"2024-01-23T08:10:17.606279+0000","last_peered":"2024-01-23T08:10:17.606279+0000","last_clean":"2024-01-23T08:10:17.606279+0000","last_became_active":"2024-01-23T07:35:17.510073+0000","last_became_peered":"2024-01-23T07:35:17.510073+0000","last_unstale":"2024-01-23T08:10:17.606279+0000","last_undegraded":"2024-01-23T08:10:17.606279+0000","last_fullsized":"2024-01-23T08:10:17.606279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:27:19.993768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":2527,"reported_epoch":1320,"state":"active+clean","last_fresh":"2024-01-23T08:10:21.887611+0000","last_change":"2024-01-23T07:35:53.382362+0000","last_active":"2024-01-23T08:10:21.887611+0000","last_peered":"2024-01-23T08:10:21.887611+0000","last_clean":"2024-01-23T08:10:21.887611+0000","last_became_active":"2024-01-23T07:35:53.376441+0000","last_became_peered":"2024-01-23T07:35:53.376441+0000","last_unstale":"2024-01-23T08:10:21.887611+0000","last_undegraded":"2024-01-23T08:10:21.887611+0000","last_fullsized":"2024-01-23T08:10:21.887611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:51:04.227769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":2558,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.027092+0000","last_change":"2024-01-23T07:35:26.286843+0000","last_active":"2024-01-23T08:10:23.027092+0000","last_peered":"2024-01-23T08:10:23.027092+0000","last_clean":"2024-01-23T08:10:23.027092+0000","last_became_active":"2024-01-23T07:35:26.273730+0000","last_became_peered":"2024-01-23T07:35:26.273730+0000","last_unstale":"2024-01-23T08:10:23.027092+0000","last_undegraded":"2024-01-23T08:10:23.027092+0000","last_fullsized":"2024-01-23T08:10:23.027092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:14:11.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":2516,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.503436+0000","last_change":"2024-01-23T07:36:02.469027+0000","last_active":"2024-01-23T08:10:19.503436+0000","last_peered":"2024-01-23T08:10:19.503436+0000","last_clean":"2024-01-23T08:10:19.503436+0000","last_became_active":"2024-01-23T07:36:02.460264+0000","last_became_peered":"2024-01-23T07:36:02.460264+0000","last_unstale":"2024-01-23T08:10:19.503436+0000","last_undegraded":"2024-01-23T08:10:19.503436+0000","last_fullsized":"2024-01-23T08:10:19.503436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:21:58.260272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'76","reported_seq":2545,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.488630+0000","last_change":"2024-01-23T07:33:26.319611+0000","last_active":"2024-01-23T08:10:19.488630+0000","last_peered":"2024-01-23T08:10:19.488630+0000","last_clean":"2024-01-23T08:10:19.488630+0000","last_became_active":"2024-01-23T07:33:25.600297+0000","last_became_peered":"2024-01-23T07:33:25.600297+0000","last_unstale":"2024-01-23T08:10:19.488630+0000","last_undegraded":"2024-01-23T08:10:19.488630+0000","last_fullsized":"2024-01-23T08:10:19.488630+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_clean_scrub_stamp":"2024-01-23T07:33:13.116593+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:32:26.093374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.647887+0000","last_change":"2024-01-23T07:33:32.660913+0000","last_active":"2024-01-23T08:10:19.647887+0000","last_peered":"2024-01-23T08:10:19.647887+0000","last_clean":"2024-01-23T08:10:19.647887+0000","last_became_active":"2024-01-23T07:33:32.655848+0000","last_became_peered":"2024-01-23T07:33:32.655848+0000","last_unstale":"2024-01-23T08:10:19.647887+0000","last_undegraded":"2024-01-23T08:10:19.647887+0000","last_fullsized":"2024-01-23T08:10:19.647887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:09:57.469855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":2556,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.013548+0000","last_change":"2024-01-23T07:35:08.880758+0000","last_active":"2024-01-23T08:10:23.013548+0000","last_peered":"2024-01-23T08:10:23.013548+0000","last_clean":"2024-01-23T08:10:23.013548+0000","last_became_active":"2024-01-23T07:35:08.862294+0000","last_became_peered":"2024-01-23T07:35:08.862294+0000","last_unstale":"2024-01-23T08:10:23.013548+0000","last_undegraded":"2024-01-23T08:10:23.013548+0000","last_fullsized":"2024-01-23T08:10:23.013548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:51:07.605185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.621092+0000","last_change":"2024-01-23T07:33:32.273001+0000","last_active":"2024-01-23T08:10:19.621092+0000","last_peered":"2024-01-23T08:10:19.621092+0000","last_clean":"2024-01-23T08:10:19.621092+0000","last_became_active":"2024-01-23T07:33:32.242199+0000","last_became_peered":"2024-01-23T07:33:32.242199+0000","last_unstale":"2024-01-23T08:10:19.621092+0000","last_undegraded":"2024-01-23T08:10:19.621092+0000","last_fullsized":"2024-01-23T08:10:19.621092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:00:09.885876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":2517,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.591970+0000","last_change":"2024-01-23T07:35:57.074880+0000","last_active":"2024-01-23T08:10:19.591970+0000","last_peered":"2024-01-23T08:10:19.591970+0000","last_clean":"2024-01-23T08:10:19.591970+0000","last_became_active":"2024-01-23T07:35:57.067585+0000","last_became_peered":"2024-01-23T07:35:57.067585+0000","last_unstale":"2024-01-23T08:10:19.591970+0000","last_undegraded":"2024-01-23T08:10:19.591970+0000","last_fullsized":"2024-01-23T08:10:19.591970+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:55:33.167910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2546,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.876825+0000","last_change":"2024-01-23T07:46:17.828288+0000","last_active":"2024-01-23T08:10:20.876825+0000","last_peered":"2024-01-23T08:10:20.876825+0000","last_clean":"2024-01-23T08:10:20.876825+0000","last_became_active":"2024-01-23T07:46:17.822757+0000","last_became_peered":"2024-01-23T07:46:17.822757+0000","last_unstale":"2024-01-23T08:10:20.876825+0000","last_undegraded":"2024-01-23T08:10:20.876825+0000","last_fullsized":"2024-01-23T08:10:20.876825+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:16:46.198098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":2522,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.616541+0000","last_change":"2024-01-23T07:35:17.207540+0000","last_active":"2024-01-23T08:10:17.616541+0000","last_peered":"2024-01-23T08:10:17.616541+0000","last_clean":"2024-01-23T08:10:17.616541+0000","last_became_active":"2024-01-23T07:35:17.149780+0000","last_became_peered":"2024-01-23T07:35:17.149780+0000","last_unstale":"2024-01-23T08:10:17.616541+0000","last_undegraded":"2024-01-23T08:10:17.616541+0000","last_fullsized":"2024-01-23T08:10:17.616541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:36:31.573133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.641389+0000","last_change":"2024-01-23T07:33:32.478085+0000","last_active":"2024-01-23T08:10:19.641389+0000","last_peered":"2024-01-23T08:10:19.641389+0000","last_clean":"2024-01-23T08:10:19.641389+0000","last_became_active":"2024-01-23T07:33:32.468117+0000","last_became_peered":"2024-01-23T07:33:32.468117+0000","last_unstale":"2024-01-23T08:10:19.641389+0000","last_undegraded":"2024-01-23T08:10:19.641389+0000","last_fullsized":"2024-01-23T08:10:19.641389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:53:49.321585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":2562,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.019762+0000","last_change":"2024-01-23T07:46:17.171650+0000","last_active":"2024-01-23T08:10:23.019762+0000","last_peered":"2024-01-23T08:10:23.019762+0000","last_clean":"2024-01-23T08:10:23.019762+0000","last_became_active":"2024-01-23T07:46:17.164304+0000","last_became_peered":"2024-01-23T07:46:17.164304+0000","last_unstale":"2024-01-23T08:10:23.019762+0000","last_undegraded":"2024-01-23T08:10:23.019762+0000","last_fullsized":"2024-01-23T08:10:23.019762+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:58.806997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2567,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.016564+0000","last_change":"2024-01-23T07:33:32.481074+0000","last_active":"2024-01-23T08:10:23.016564+0000","last_peered":"2024-01-23T08:10:23.016564+0000","last_clean":"2024-01-23T08:10:23.016564+0000","last_became_active":"2024-01-23T07:33:32.474543+0000","last_became_peered":"2024-01-23T07:33:32.474543+0000","last_unstale":"2024-01-23T08:10:23.016564+0000","last_undegraded":"2024-01-23T08:10:23.016564+0000","last_fullsized":"2024-01-23T08:10:23.016564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:34:40.212856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":2542,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.905321+0000","last_change":"2024-01-23T07:35:28.743786+0000","last_active":"2024-01-23T08:10:20.905321+0000","last_peered":"2024-01-23T08:10:20.905321+0000","last_clean":"2024-01-23T08:10:20.905321+0000","last_became_active":"2024-01-23T07:35:28.738559+0000","last_became_peered":"2024-01-23T07:35:28.738559+0000","last_unstale":"2024-01-23T08:10:20.905321+0000","last_undegraded":"2024-01-23T08:10:20.905321+0000","last_fullsized":"2024-01-23T08:10:20.905321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:43:03.397366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2548,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.655956+0000","last_change":"2024-01-23T07:33:32.371113+0000","last_active":"2024-01-23T08:10:19.655956+0000","last_peered":"2024-01-23T08:10:19.655956+0000","last_clean":"2024-01-23T08:10:19.655956+0000","last_became_active":"2024-01-23T07:33:32.353826+0000","last_became_peered":"2024-01-23T07:33:32.353826+0000","last_unstale":"2024-01-23T08:10:19.655956+0000","last_undegraded":"2024-01-23T08:10:19.655956+0000","last_fullsized":"2024-01-23T08:10:19.655956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:16:09.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":2523,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.589721+0000","last_change":"2024-01-23T07:35:16.873946+0000","last_active":"2024-01-23T08:10:17.589721+0000","last_peered":"2024-01-23T08:10:17.589721+0000","last_clean":"2024-01-23T08:10:17.589721+0000","last_became_active":"2024-01-23T07:35:16.868129+0000","last_became_peered":"2024-01-23T07:35:16.868129+0000","last_unstale":"2024-01-23T08:10:17.589721+0000","last_undegraded":"2024-01-23T08:10:17.589721+0000","last_fullsized":"2024-01-23T08:10:17.589721+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:02:37.157717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2551,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.922297+0000","last_change":"2024-01-23T07:33:32.719529+0000","last_active":"2024-01-23T08:10:20.922297+0000","last_peered":"2024-01-23T08:10:20.922297+0000","last_clean":"2024-01-23T08:10:20.922297+0000","last_became_active":"2024-01-23T07:33:32.693171+0000","last_became_peered":"2024-01-23T07:33:32.693171+0000","last_unstale":"2024-01-23T08:10:20.922297+0000","last_undegraded":"2024-01-23T08:10:20.922297+0000","last_fullsized":"2024-01-23T08:10:20.922297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:08:58.102768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":2523,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.599919+0000","last_change":"2024-01-23T07:35:17.021056+0000","last_active":"2024-01-23T08:10:17.599919+0000","last_peered":"2024-01-23T08:10:17.599919+0000","last_clean":"2024-01-23T08:10:17.599919+0000","last_became_active":"2024-01-23T07:35:17.011327+0000","last_became_peered":"2024-01-23T07:35:17.011327+0000","last_unstale":"2024-01-23T08:10:17.599919+0000","last_undegraded":"2024-01-23T08:10:17.599919+0000","last_fullsized":"2024-01-23T08:10:17.599919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:03:58.748267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2546,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.675254+0000","last_change":"2024-01-23T07:33:32.685400+0000","last_active":"2024-01-23T08:10:19.675254+0000","last_peered":"2024-01-23T08:10:19.675254+0000","last_clean":"2024-01-23T08:10:19.675254+0000","last_became_active":"2024-01-23T07:33:32.676672+0000","last_became_peered":"2024-01-23T07:33:32.676672+0000","last_unstale":"2024-01-23T08:10:19.675254+0000","last_undegraded":"2024-01-23T08:10:19.675254+0000","last_fullsized":"2024-01-23T08:10:19.675254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:20:29.458030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":2523,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.592827+0000","last_change":"2024-01-23T07:35:17.450588+0000","last_active":"2024-01-23T08:10:17.592827+0000","last_peered":"2024-01-23T08:10:17.592827+0000","last_clean":"2024-01-23T08:10:17.592827+0000","last_became_active":"2024-01-23T07:35:17.445116+0000","last_became_peered":"2024-01-23T07:35:17.445116+0000","last_unstale":"2024-01-23T08:10:17.592827+0000","last_undegraded":"2024-01-23T08:10:17.592827+0000","last_fullsized":"2024-01-23T08:10:17.592827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:05:00.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":2554,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.009312+0000","last_change":"2024-01-23T07:35:23.296635+0000","last_active":"2024-01-23T08:10:23.009312+0000","last_peered":"2024-01-23T08:10:23.009312+0000","last_clean":"2024-01-23T08:10:23.009312+0000","last_became_active":"2024-01-23T07:35:23.240102+0000","last_became_peered":"2024-01-23T07:35:23.240102+0000","last_unstale":"2024-01-23T08:10:23.009312+0000","last_undegraded":"2024-01-23T08:10:23.009312+0000","last_fullsized":"2024-01-23T08:10:23.009312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:44:36.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":2491,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.633448+0000","last_change":"2024-01-23T07:36:16.164085+0000","last_active":"2024-01-23T08:10:17.633448+0000","last_peered":"2024-01-23T08:10:17.633448+0000","last_clean":"2024-01-23T08:10:17.633448+0000","last_became_active":"2024-01-23T07:36:16.154523+0000","last_became_peered":"2024-01-23T07:36:16.154523+0000","last_unstale":"2024-01-23T08:10:17.633448+0000","last_undegraded":"2024-01-23T08:10:17.633448+0000","last_fullsized":"2024-01-23T08:10:17.633448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:42:08.960329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":2525,"reported_epoch":1315,"state":"active+clean","last_fresh":"2024-01-23T08:10:17.596530+0000","last_change":"2024-01-23T07:35:53.515139+0000","last_active":"2024-01-23T08:10:17.596530+0000","last_peered":"2024-01-23T08:10:17.596530+0000","last_clean":"2024-01-23T08:10:17.596530+0000","last_became_active":"2024-01-23T07:35:53.509895+0000","last_became_peered":"2024-01-23T07:35:53.509895+0000","last_unstale":"2024-01-23T08:10:17.596530+0000","last_undegraded":"2024-01-23T08:10:17.596530+0000","last_fullsized":"2024-01-23T08:10:17.596530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:27:03.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1","version":"115'7","reported_seq":2546,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.639922+0000","last_change":"2024-01-23T07:35:25.280614+0000","last_active":"2024-01-23T08:10:19.639922+0000","last_peered":"2024-01-23T08:10:19.639922+0000","last_clean":"2024-01-23T08:10:19.639922+0000","last_became_active":"2024-01-23T07:35:25.275034+0000","last_became_peered":"2024-01-23T07:35:25.275034+0000","last_unstale":"2024-01-23T08:10:19.639922+0000","last_undegraded":"2024-01-23T08:10:19.639922+0000","last_fullsized":"2024-01-23T08:10:19.639922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:49:35.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":2520,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.507703+0000","last_change":"2024-01-23T07:35:15.252226+0000","last_active":"2024-01-23T08:10:19.507703+0000","last_peered":"2024-01-23T08:10:19.507703+0000","last_clean":"2024-01-23T08:10:19.507703+0000","last_became_active":"2024-01-23T07:35:15.231845+0000","last_became_peered":"2024-01-23T07:35:15.231845+0000","last_unstale":"2024-01-23T08:10:19.507703+0000","last_undegraded":"2024-01-23T08:10:19.507703+0000","last_fullsized":"2024-01-23T08:10:19.507703+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:12:07.791338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":2534,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.897968+0000","last_change":"2024-01-23T07:46:17.147281+0000","last_active":"2024-01-23T08:10:20.897968+0000","last_peered":"2024-01-23T08:10:20.897968+0000","last_clean":"2024-01-23T08:10:20.897968+0000","last_became_active":"2024-01-23T07:46:17.141733+0000","last_became_peered":"2024-01-23T07:46:17.141733+0000","last_unstale":"2024-01-23T08:10:20.897968+0000","last_undegraded":"2024-01-23T08:10:20.897968+0000","last_fullsized":"2024-01-23T08:10:20.897968+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:14:19.035625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":2521,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.495914+0000","last_change":"2024-01-23T07:35:11.695684+0000","last_active":"2024-01-23T08:10:19.495914+0000","last_peered":"2024-01-23T08:10:19.495914+0000","last_clean":"2024-01-23T08:10:19.495914+0000","last_became_active":"2024-01-23T07:35:11.686621+0000","last_became_peered":"2024-01-23T07:35:11.686621+0000","last_unstale":"2024-01-23T08:10:19.495914+0000","last_undegraded":"2024-01-23T08:10:19.495914+0000","last_fullsized":"2024-01-23T08:10:19.495914+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:21:41.433898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":2528,"reported_epoch":1320,"state":"active+clean","last_fresh":"2024-01-23T08:10:21.871152+0000","last_change":"2024-01-23T07:35:52.897767+0000","last_active":"2024-01-23T08:10:21.871152+0000","last_peered":"2024-01-23T08:10:21.871152+0000","last_clean":"2024-01-23T08:10:21.871152+0000","last_became_active":"2024-01-23T07:35:52.882762+0000","last_became_peered":"2024-01-23T07:35:52.882762+0000","last_unstale":"2024-01-23T08:10:21.871152+0000","last_undegraded":"2024-01-23T08:10:21.871152+0000","last_fullsized":"2024-01-23T08:10:21.871152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:43:06.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":2514,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.552708+0000","last_change":"2024-01-23T07:35:31.951915+0000","last_active":"2024-01-23T08:10:19.552708+0000","last_peered":"2024-01-23T08:10:19.552708+0000","last_clean":"2024-01-23T08:10:19.552708+0000","last_became_active":"2024-01-23T07:35:31.935370+0000","last_became_peered":"2024-01-23T07:35:31.935370+0000","last_unstale":"2024-01-23T08:10:19.552708+0000","last_undegraded":"2024-01-23T08:10:19.552708+0000","last_fullsized":"2024-01-23T08:10:19.552708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T07:42:47.447343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":2535,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.882381+0000","last_change":"2024-01-23T07:46:17.160020+0000","last_active":"2024-01-23T08:10:20.882381+0000","last_peered":"2024-01-23T08:10:20.882381+0000","last_clean":"2024-01-23T08:10:20.882381+0000","last_became_active":"2024-01-23T07:46:17.153624+0000","last_became_peered":"2024-01-23T07:46:17.153624+0000","last_unstale":"2024-01-23T08:10:20.882381+0000","last_undegraded":"2024-01-23T08:10:20.882381+0000","last_fullsized":"2024-01-23T08:10:20.882381+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T07:45:27.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":2515,"reported_epoch":1317,"state":"active+clean","last_fresh":"2024-01-23T08:10:19.558978+0000","last_change":"2024-01-23T07:35:55.640548+0000","last_active":"2024-01-23T08:10:19.558978+0000","last_peered":"2024-01-23T08:10:19.558978+0000","last_clean":"2024-01-23T08:10:19.558978+0000","last_became_active":"2024-01-23T07:35:55.634625+0000","last_became_peered":"2024-01-23T07:35:55.634625+0000","last_unstale":"2024-01-23T08:10:19.558978+0000","last_undegraded":"2024-01-23T08:10:19.558978+0000","last_fullsized":"2024-01-23T08:10:19.558978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:59:35.575710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":2536,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.874291+0000","last_change":"2024-01-23T07:46:17.111555+0000","last_active":"2024-01-23T08:10:20.874291+0000","last_peered":"2024-01-23T08:10:20.874291+0000","last_clean":"2024-01-23T08:10:20.874291+0000","last_became_active":"2024-01-23T07:46:17.105960+0000","last_became_peered":"2024-01-23T07:46:17.105960+0000","last_unstale":"2024-01-23T08:10:20.874291+0000","last_undegraded":"2024-01-23T08:10:20.874291+0000","last_fullsized":"2024-01-23T08:10:20.874291+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:36:28.032265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":19,"seq":81604379072,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72088,"kb_used_data":4800,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299752,"statfs":{"total":96636764160,"available":96562946048,"internally_reserved":0,"allocated":4915200,"data_stored":2237581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":13.061,"5min":24.649999999999999,"15min":18.510999999999999},"min":{"1min":4.6820000000000004,"5min":4.6390000000000002,"15min":4.4500000000000002},"max":{"1min":40.679000000000002,"5min":226.16999999999999,"15min":259.17200000000003},"last":13.391999999999999},{"interface":"front","average":{"1min":13.103,"5min":27.594000000000001,"15min":20.172000000000001},"min":{"1min":5.3700000000000001,"5min":4.5830000000000002,"15min":4.5800000000000001},"max":{"1min":32.253999999999998,"5min":335.11099999999999,"15min":335.11099999999999},"last":10.34}]},{"osd":1,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":11.526999999999999,"5min":25.579000000000001,"15min":20.094999999999999},"min":{"1min":4.7089999999999996,"5min":4.7089999999999996,"15min":4.7089999999999996},"max":{"1min":35.301000000000002,"5min":202.30000000000001,"15min":202.30000000000001},"last":9.2880000000000003},{"interface":"front","average":{"1min":17.094999999999999,"5min":27.420999999999999,"15min":23.341999999999999},"min":{"1min":7.7770000000000001,"5min":7.0030000000000001,"15min":6.8550000000000004},"max":{"1min":46.988999999999997,"5min":129.023,"15min":213.935},"last":9.5630000000000006}]},{"osd":2,"last update":"Tue Jan 23 08:10:18 2024","interfaces":[{"interface":"back","average":{"1min":17.052,"5min":41.604999999999997,"15min":31.245999999999999},"min":{"1min":7.8029999999999999,"5min":6.6710000000000003,"15min":6.5270000000000001},"max":{"1min":30.015999999999998,"5min":689.02099999999996,"15min":689.02099999999996},"last":25.832000000000001},{"interface":"front","average":{"1min":15.247999999999999,"5min":30.026,"15min":27.16},"min":{"1min":8.3960000000000008,"5min":6.556,"15min":6.556},"max":{"1min":26.483000000000001,"5min":363.96699999999998,"15min":386.762},"last":8.2439999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":20.992999999999999,"5min":25.806999999999999,"15min":24.355},"min":{"1min":10.17,"5min":7.8150000000000004,"15min":7.8150000000000004},"max":{"1min":59.957000000000001,"5min":172.78299999999999,"15min":289.80599999999998},"last":11.805},{"interface":"front","average":{"1min":22.202999999999999,"5min":29.404,"15min":28.827999999999999},"min":{"1min":10.856999999999999,"5min":9.9879999999999995,"15min":9.5510000000000002},"max":{"1min":60.607999999999997,"5min":177.40000000000001,"15min":307.245},"last":26.818000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":20.713000000000001,"5min":28.288,"15min":28.074000000000002},"min":{"1min":6.8029999999999999,"5min":6.8029999999999999,"15min":6.8029999999999999},"max":{"1min":44.375,"5min":201.06200000000001,"15min":359.69900000000001},"last":21.858000000000001},{"interface":"front","average":{"1min":23.881,"5min":28.484999999999999,"15min":28.401},"min":{"1min":12.388999999999999,"5min":10.301,"15min":9.407},"max":{"1min":79.674000000000007,"5min":149.059,"15min":334.642},"last":23.311}]},{"osd":6,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":23.018999999999998,"5min":32.515999999999998,"15min":32.387999999999998},"min":{"1min":10.845000000000001,"5min":8.4260000000000002,"15min":8.4260000000000002},"max":{"1min":73.620999999999995,"5min":199.66399999999999,"15min":341.05700000000002},"last":27.483000000000001},{"interface":"front","average":{"1min":29.157,"5min":34.218000000000004,"15min":29.725000000000001},"min":{"1min":15.654,"5min":11.496,"15min":6.6390000000000002},"max":{"1min":101.759,"5min":162.982,"15min":334.94600000000003},"last":28.372}]},{"osd":7,"last update":"Tue Jan 23 08:09:55 2024","interfaces":[{"interface":"back","average":{"1min":14.962999999999999,"5min":23.611000000000001,"15min":25.231000000000002},"min":{"1min":7.3460000000000001,"5min":7.298,"15min":7.2309999999999999},"max":{"1min":63.154000000000003,"5min":191.524,"15min":223.053},"last":12.481},{"interface":"front","average":{"1min":25.978000000000002,"5min":33.332000000000001,"15min":25.420000000000002},"min":{"1min":9.9719999999999995,"5min":8.4459999999999997,"15min":6.9189999999999996},"max":{"1min":99.994,"5min":211.773,"15min":281.75299999999999},"last":26.501000000000001}]}]},{"osd":1,"up_from":19,"seq":81604379071,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72468,"kb_used_data":5188,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299372,"statfs":{"total":96636764160,"available":96562556928,"internally_reserved":0,"allocated":5312512,"data_stored":2635416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:24 2024","interfaces":[{"interface":"back","average":{"1min":10.567,"5min":20.952000000000002,"15min":19.978999999999999},"min":{"1min":6.4989999999999997,"5min":5.4100000000000001,"15min":5.4100000000000001},"max":{"1min":24.219999999999999,"5min":174.22800000000001,"15min":244.16},"last":20.184999999999999},{"interface":"front","average":{"1min":17.425999999999998,"5min":27.312000000000001,"15min":28.744},"min":{"1min":8.5009999999999994,"5min":6.7830000000000004,"15min":6.7830000000000004},"max":{"1min":38.683,"5min":198.155,"15min":260.27800000000002},"last":20.760999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:09:32 2024","interfaces":[{"interface":"back","average":{"1min":15.324,"5min":25.154,"15min":25.584},"min":{"1min":8.266,"5min":8.266,"15min":6.2699999999999996},"max":{"1min":33.029000000000003,"5min":207.15100000000001,"15min":243.33000000000001},"last":29.283000000000001},{"interface":"front","average":{"1min":10.833,"5min":18.463000000000001,"15min":25.510999999999999},"min":{"1min":5.6710000000000003,"5min":4.915,"15min":4.915},"max":{"1min":19.279,"5min":167.71199999999999,"15min":366.99700000000001},"last":31.012}]},{"osd":3,"last update":"Tue Jan 23 08:09:46 2024","interfaces":[{"interface":"back","average":{"1min":21.405999999999999,"5min":28.048999999999999,"15min":23.024000000000001},"min":{"1min":8.6920000000000002,"5min":6.0270000000000001,"15min":5.3650000000000002},"max":{"1min":100.602,"5min":291.79300000000001,"15min":291.79300000000001},"last":13.76},{"interface":"front","average":{"1min":21.239000000000001,"5min":20.696000000000002,"15min":25.032},"min":{"1min":6.1360000000000001,"5min":5.3289999999999997,"15min":5.3289999999999997},"max":{"1min":88.227999999999994,"5min":221.50899999999999,"15min":398.98599999999999},"last":17.399000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":23.504999999999999,"5min":30.498000000000001,"15min":32.963000000000001},"min":{"1min":11.525,"5min":8.2940000000000005,"15min":7.641},"max":{"1min":36.862000000000002,"5min":204.095,"15min":572.26999999999998},"last":16.757000000000001},{"interface":"front","average":{"1min":12.919,"5min":16.268999999999998,"15min":20.911000000000001},"min":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"max":{"1min":40.198,"5min":78.813000000000002,"15min":411.84399999999999},"last":12.363}]},{"osd":5,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":29.154,"5min":28.667000000000002,"15min":31.228000000000002},"min":{"1min":7.6900000000000004,"5min":7.6900000000000004,"15min":7.6900000000000004},"max":{"1min":106.607,"5min":168.93000000000001,"15min":376.55700000000002},"last":13.143000000000001},{"interface":"front","average":{"1min":29.056000000000001,"5min":26.309999999999999,"15min":27.195},"min":{"1min":7.7670000000000003,"5min":7.7670000000000003,"15min":6.3959999999999999},"max":{"1min":91.256,"5min":173.46899999999999,"15min":364.32600000000002},"last":18.881}]},{"osd":6,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":25.513999999999999,"5min":31.672000000000001,"15min":34.091000000000001},"min":{"1min":15.657999999999999,"5min":10.664,"15min":10.664},"max":{"1min":53.466000000000001,"5min":174.54400000000001,"15min":377.375},"last":19.477},{"interface":"front","average":{"1min":22.515000000000001,"5min":26.417999999999999,"15min":26.864000000000001},"min":{"1min":9.1940000000000008,"5min":7.0590000000000002,"15min":7.0590000000000002},"max":{"1min":93.706999999999994,"5min":176.499,"15min":248.40000000000001},"last":14.324999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":21.986000000000001,"5min":26.722999999999999,"15min":22.699999999999999},"min":{"1min":9.6899999999999995,"5min":6.8049999999999997,"15min":6.8049999999999997},"max":{"1min":95.328000000000003,"5min":309.55900000000003,"15min":309.55900000000003},"last":15.849},{"interface":"front","average":{"1min":24.766999999999999,"5min":30.609999999999999,"15min":27.841000000000001},"min":{"1min":11.859999999999999,"5min":11.134,"15min":8.3670000000000009},"max":{"1min":98.653000000000006,"5min":169.82300000000001,"15min":245.946},"last":22.257000000000001}]}]},{"osd":4,"up_from":18,"seq":77309411776,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76264,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295576,"statfs":{"total":96636764160,"available":96558669824,"internally_reserved":0,"allocated":4939776,"data_stored":2252311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":14.598000000000001,"5min":23.437999999999999,"15min":22.77},"min":{"1min":5.8570000000000002,"5min":5.2850000000000001,"15min":5.2850000000000001},"max":{"1min":98.227999999999994,"5min":371.233,"15min":371.233},"last":13.999000000000001},{"interface":"front","average":{"1min":18.530999999999999,"5min":24.696000000000002,"15min":25.018000000000001},"min":{"1min":7.8490000000000002,"5min":6.1909999999999998,"15min":5.9210000000000003},"max":{"1min":106.56699999999999,"5min":244.11199999999999,"15min":351.55700000000002},"last":15.613}]},{"osd":1,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":25.187000000000001,"5min":25.859999999999999,"15min":26.457999999999998},"min":{"1min":8.4510000000000005,"5min":6.3609999999999998,"15min":5.6040000000000001},"max":{"1min":147.08799999999999,"5min":260.22500000000002,"15min":353.72699999999998},"last":14.852},{"interface":"front","average":{"1min":28.363,"5min":33.558,"15min":32.466999999999999},"min":{"1min":12.493,"5min":10.728999999999999,"15min":7.5830000000000002},"max":{"1min":149.196,"5min":271.54700000000003,"15min":352.48700000000002},"last":18.957999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:09:27 2024","interfaces":[{"interface":"back","average":{"1min":13.788,"5min":47.954999999999998,"15min":30.994},"min":{"1min":5.3090000000000002,"5min":4.5800000000000001,"15min":4.5800000000000001},"max":{"1min":103.143,"5min":2731.4580000000001,"15min":2731.4580000000001},"last":6.9320000000000004},{"interface":"front","average":{"1min":16.902999999999999,"5min":42.124000000000002,"15min":27.620000000000001},"min":{"1min":6.7999999999999998,"5min":6.0640000000000001,"15min":4.6040000000000001},"max":{"1min":75.646000000000001,"5min":1368.422,"15min":1368.422},"last":10.259}]},{"osd":3,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":14.923,"5min":21.501000000000001,"15min":27.437000000000001},"min":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"max":{"1min":92.784999999999997,"5min":185.97900000000001,"15min":367.24000000000001},"last":9.3520000000000003},{"interface":"front","average":{"1min":21.876999999999999,"5min":30.088999999999999,"15min":28.812000000000001},"min":{"1min":12.944000000000001,"5min":10.311,"15min":6.4779999999999998},"max":{"1min":109.018,"5min":502.47000000000003,"15min":502.47000000000003},"last":16.41}]},{"osd":5,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":18.542000000000002,"5min":19.931000000000001,"15min":22.861999999999998},"min":{"1min":5.859,"5min":5.859,"15min":5.859},"max":{"1min":92.823999999999998,"5min":109.624,"15min":482.44299999999998},"last":8.0310000000000006},{"interface":"front","average":{"1min":20.876000000000001,"5min":25.094000000000001,"15min":23.469000000000001},"min":{"1min":8.7230000000000008,"5min":6.1280000000000001,"15min":5.3170000000000002},"max":{"1min":108.36499999999999,"5min":227.20500000000001,"15min":339.04300000000001},"last":12.863}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.561,"5min":25.599,"15min":28.395},"min":{"1min":9.6229999999999993,"5min":7.8109999999999999,"15min":7.8109999999999999},"max":{"1min":110.756,"5min":300.51999999999998,"15min":353.113},"last":12.180999999999999},{"interface":"front","average":{"1min":23.277000000000001,"5min":28.373000000000001,"15min":27.132000000000001},"min":{"1min":12.647,"5min":10.74,"15min":6.8090000000000002},"max":{"1min":109.562,"5min":208.05699999999999,"15min":349.64499999999998},"last":17.225999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":26.695,"5min":34.959000000000003,"15min":32.031999999999996},"min":{"1min":15.186,"5min":7.7939999999999996,"15min":7.3719999999999999},"max":{"1min":116.116,"5min":275.20999999999998,"15min":395.82299999999998},"last":18.023},{"interface":"front","average":{"1min":26.236000000000001,"5min":35.244,"15min":32.054000000000002},"min":{"1min":16.350999999999999,"5min":12.57,"15min":6.4859999999999998},"max":{"1min":124.672,"5min":184.47499999999999,"15min":438.92000000000002},"last":19.739999999999998}]}]},{"osd":7,"up_from":473,"seq":2031519531439,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72080,"kb_used_data":4796,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299760,"statfs":{"total":96636764160,"available":96562954240,"internally_reserved":0,"allocated":4911104,"data_stored":2237576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":10.305999999999999,"5min":22.015000000000001,"15min":16.207999999999998},"min":{"1min":5.8280000000000003,"5min":5.6550000000000002,"15min":4.9550000000000001},"max":{"1min":24.335000000000001,"5min":282.28800000000001,"15min":282.28800000000001},"last":5.5759999999999996},{"interface":"front","average":{"1min":18.126999999999999,"5min":28.951000000000001,"15min":22.047000000000001},"min":{"1min":8.6720000000000006,"5min":7.4989999999999997,"15min":5.476},"max":{"1min":48.290999999999997,"5min":285.887,"15min":285.887},"last":8.3949999999999996}]},{"osd":1,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":15.558999999999999,"5min":18.123999999999999,"15min":18.305},"min":{"1min":6.7359999999999998,"5min":4.8440000000000003,"15min":4.6509999999999998},"max":{"1min":74.322999999999993,"5min":162.80500000000001,"15min":199.09399999999999},"last":9.2300000000000004},{"interface":"front","average":{"1min":15.768000000000001,"5min":25.341999999999999,"15min":22.677},"min":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.1550000000000002},"max":{"1min":86.662000000000006,"5min":238.892,"15min":280.24299999999999},"last":10.464}]},{"osd":2,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.838000000000001,"5min":37.078000000000003,"15min":25.183},"min":{"1min":10.106999999999999,"5min":6.8150000000000004,"15min":5.8129999999999997},"max":{"1min":38.683,"5min":1088.116,"15min":1088.116},"last":18.138999999999999},{"interface":"front","average":{"1min":14.474,"5min":35.444000000000003,"15min":25.821000000000002},"min":{"1min":8.9239999999999995,"5min":6.9080000000000004,"15min":5.2699999999999996},"max":{"1min":34.753,"5min":1187.3219999999999,"15min":1187.3219999999999},"last":12.132999999999999}]},{"osd":3,"last update":"Tue Jan 23 08:10:15 2024","interfaces":[{"interface":"back","average":{"1min":19.507000000000001,"5min":23.98,"15min":22.635999999999999},"min":{"1min":8.1560000000000006,"5min":7.7309999999999999,"15min":6.1749999999999998},"max":{"1min":65.203999999999994,"5min":177.09700000000001,"15min":313.31099999999998},"last":13.205},{"interface":"front","average":{"1min":24.954999999999998,"5min":25.353000000000002,"15min":23.792000000000002},"min":{"1min":9.6549999999999994,"5min":6.3029999999999999,"15min":6.3029999999999999},"max":{"1min":84.671999999999997,"5min":179.13999999999999,"15min":228.626},"last":15.894}]},{"osd":4,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.268000000000001,"5min":25.036000000000001,"15min":23.661000000000001},"min":{"1min":7.444,"5min":6.5149999999999997,"15min":6.4850000000000003},"max":{"1min":64.384,"5min":206.381,"15min":277.70400000000001},"last":11.468999999999999},{"interface":"front","average":{"1min":19.050999999999998,"5min":24.832999999999998,"15min":23.053000000000001},"min":{"1min":10.968,"5min":7.7930000000000001,"15min":7.7930000000000001},"max":{"1min":34.298999999999999,"5min":186.768,"15min":320.26799999999997},"last":16.795000000000002}]},{"osd":5,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":18.742999999999999,"5min":29.033999999999999,"15min":25.672999999999998},"min":{"1min":8.7370000000000001,"5min":8.6809999999999992,"15min":8.0350000000000001},"max":{"1min":29.145,"5min":323.63400000000001,"15min":323.63400000000001},"last":17.513999999999999},{"interface":"front","average":{"1min":20.257000000000001,"5min":29.279,"15min":26.036000000000001},"min":{"1min":6.5529999999999999,"5min":6.5529999999999999,"15min":6.5529999999999999},"max":{"1min":69.991,"5min":263.19799999999998,"15min":263.19799999999998},"last":13.912000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":16.844000000000001,"5min":26.978999999999999,"15min":25.648},"min":{"1min":8.0589999999999993,"5min":7.8849999999999998,"15min":7.1449999999999996},"max":{"1min":36.491,"5min":232.35599999999999,"15min":232.35599999999999},"last":14.664},{"interface":"front","average":{"1min":19.102,"5min":30.035,"15min":26.268000000000001},"min":{"1min":10.395,"5min":7.8029999999999999,"15min":7.4320000000000004},"max":{"1min":29.07,"5min":283.27800000000002,"15min":435.91899999999998},"last":19.350999999999999}]}]},{"osd":2,"up_from":16,"seq":68719477171,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72048,"kb_used_data":4772,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299792,"statfs":{"total":96636764160,"available":96562987008,"internally_reserved":0,"allocated":4886528,"data_stored":2221793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":8.8000000000000007,"5min":27.609999999999999,"15min":18.635999999999999},"min":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"max":{"1min":21.404,"5min":1085.3969999999999,"15min":1085.3969999999999},"last":21.388000000000002},{"interface":"front","average":{"1min":12.24,"5min":32.030000000000001,"15min":23.178000000000001},"min":{"1min":6.7759999999999998,"5min":5.093,"15min":4.5380000000000003},"max":{"1min":20.372,"5min":938.18899999999996,"15min":938.18899999999996},"last":6.9249999999999998}]},{"osd":1,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":11.996,"5min":22.428999999999998,"15min":22.510999999999999},"min":{"1min":7.5,"5min":5.2000000000000002,"15min":5.0389999999999997},"max":{"1min":27.957000000000001,"5min":281.33499999999998,"15min":310.05200000000002},"last":7.8879999999999999},{"interface":"front","average":{"1min":16.562999999999999,"5min":38.578000000000003,"15min":32.250999999999998},"min":{"1min":8.6110000000000007,"5min":6.2220000000000004,"15min":6.2220000000000004},"max":{"1min":27.175999999999998,"5min":969.31899999999996,"15min":969.31899999999996},"last":27.952000000000002}]},{"osd":3,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":16.364000000000001,"5min":35.424999999999997,"15min":28.559999999999999},"min":{"1min":6.5270000000000001,"5min":6.5270000000000001,"15min":5.9909999999999997},"max":{"1min":79.376000000000005,"5min":1096.0550000000001,"15min":1096.0550000000001},"last":8.5879999999999992},{"interface":"front","average":{"1min":20.065000000000001,"5min":37.469999999999999,"15min":30.396999999999998},"min":{"1min":9.1189999999999998,"5min":8.782,"15min":8.1910000000000007},"max":{"1min":81.116,"5min":1097.8199999999999,"15min":1097.8199999999999},"last":22.763999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":16.434999999999999,"5min":29.039999999999999,"15min":27.286000000000001},"min":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":6.742},"max":{"1min":78.128,"5min":454.44299999999998,"15min":454.44299999999998},"last":22.082999999999998},{"interface":"front","average":{"1min":16.774000000000001,"5min":34.783000000000001,"15min":29.050000000000001},"min":{"1min":8.423,"5min":8.423,"15min":7.5380000000000003},"max":{"1min":25.576000000000001,"5min":1087.472,"15min":1087.472},"last":20.690999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":14.894,"5min":28.713999999999999,"15min":24.637},"min":{"1min":8.1760000000000002,"5min":8.0719999999999992,"15min":8.0719999999999992},"max":{"1min":24.890000000000001,"5min":455.05500000000001,"15min":455.05500000000001},"last":28.541},{"interface":"front","average":{"1min":17.791,"5min":34.188000000000002,"15min":29.135999999999999},"min":{"1min":9.9220000000000006,"5min":9.9220000000000006,"15min":9.1500000000000004},"max":{"1min":28.599,"5min":455.66699999999997,"15min":455.66699999999997},"last":33.380000000000003}]},{"osd":6,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":17.425000000000001,"5min":40.386000000000003,"15min":29.199000000000002},"min":{"1min":9.6199999999999992,"5min":7.6719999999999997,"15min":7.6189999999999998},"max":{"1min":29.992000000000001,"5min":977.35299999999995,"15min":977.35299999999995},"last":27.268999999999998},{"interface":"front","average":{"1min":20.593,"5min":44.506,"15min":32.329000000000001},"min":{"1min":9.0060000000000002,"5min":9.0060000000000002,"15min":9.0060000000000002},"max":{"1min":30.98,"5min":982.83100000000002,"15min":982.83100000000002},"last":31.09}]},{"osd":7,"last update":"Tue Jan 23 08:10:04 2024","interfaces":[{"interface":"back","average":{"1min":27.013000000000002,"5min":50.5,"15min":33.725999999999999},"min":{"1min":11.968,"5min":10.092000000000001,"15min":8.9199999999999999},"max":{"1min":149.69399999999999,"5min":979.63699999999994,"15min":979.63699999999994},"last":19.434000000000001},{"interface":"front","average":{"1min":35.767000000000003,"5min":57.726999999999997,"15min":38.661000000000001},"min":{"1min":15.068,"5min":10.776999999999999,"15min":8.4049999999999994},"max":{"1min":156.78100000000001,"5min":984.54899999999998,"15min":984.54899999999998},"last":32.543999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542589,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72072,"kb_used_data":4796,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299768,"statfs":{"total":96636764160,"available":96562962432,"internally_reserved":0,"allocated":4911104,"data_stored":2237576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":14.076000000000001,"5min":26.460000000000001,"15min":18.937999999999999},"min":{"1min":5.5800000000000001,"5min":5.4349999999999996,"15min":4.6289999999999996},"max":{"1min":58.256999999999998,"5min":240.86000000000001,"15min":259.21699999999998},"last":15.618},{"interface":"front","average":{"1min":20.256,"5min":34.912999999999997,"15min":22.837},"min":{"1min":10.065,"5min":8.3789999999999996,"15min":4.3719999999999999},"max":{"1min":85.894000000000005,"5min":241.94999999999999,"15min":241.94999999999999},"last":19.550000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:09:29 2024","interfaces":[{"interface":"back","average":{"1min":10.087999999999999,"5min":30.771999999999998,"15min":22.111000000000001},"min":{"1min":5.6349999999999998,"5min":5.6349999999999998,"15min":4.8499999999999996},"max":{"1min":22.939,"5min":272.22300000000001,"15min":272.22300000000001},"last":30.334},{"interface":"front","average":{"1min":20.882000000000001,"5min":41.527000000000001,"15min":27.675000000000001},"min":{"1min":10.710000000000001,"5min":8.9939999999999998,"15min":5.8470000000000004},"max":{"1min":37.408999999999999,"5min":272.08100000000002,"15min":328.67500000000001},"last":35.152000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":20.913,"5min":32.823999999999998,"15min":23.902000000000001},"min":{"1min":9.9969999999999999,"5min":6.7539999999999996,"15min":6.7539999999999996},"max":{"1min":40.466999999999999,"5min":205.28700000000001,"15min":205.28700000000001},"last":14.095000000000001},{"interface":"front","average":{"1min":13.377000000000001,"5min":27.677,"15min":21.324000000000002},"min":{"1min":7.2839999999999998,"5min":6.2450000000000001,"15min":6.2450000000000001},"max":{"1min":41.201999999999998,"5min":205.19499999999999,"15min":205.19499999999999},"last":10.047000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.251999999999999,"5min":31.273,"15min":23.646000000000001},"min":{"1min":9.9580000000000002,"5min":7.835,"15min":6.6689999999999996},"max":{"1min":35.313000000000002,"5min":270.214,"15min":270.214},"last":7.8310000000000004},{"interface":"front","average":{"1min":12.816000000000001,"5min":24.617000000000001,"15min":19.789999999999999},"min":{"1min":6.8490000000000002,"5min":6.4409999999999998,"15min":6.0579999999999998},"max":{"1min":27.478999999999999,"5min":206.066,"15min":206.066},"last":7.1959999999999997}]},{"osd":5,"last update":"Tue Jan 23 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":23.785,"5min":39.161000000000001,"15min":28.478000000000002},"min":{"1min":14.23,"5min":10.859,"15min":7.3689999999999998},"max":{"1min":83.944000000000003,"5min":266.38900000000001,"15min":269.887},"last":11.551},{"interface":"front","average":{"1min":17.472999999999999,"5min":25.440999999999999,"15min":22.010999999999999},"min":{"1min":8.0150000000000006,"5min":6.5090000000000003,"15min":5.431},"max":{"1min":76.481999999999999,"5min":267.16199999999998,"15min":267.16199999999998},"last":8.5350000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.571000000000002,"5min":35.337000000000003,"15min":28.390000000000001},"min":{"1min":8.4410000000000007,"5min":8.4410000000000007,"15min":8.2970000000000006},"max":{"1min":38.991,"5min":306.05900000000003,"15min":306.05900000000003},"last":15.032},{"interface":"front","average":{"1min":16.009,"5min":29.239000000000001,"15min":25.030000000000001},"min":{"1min":7.5499999999999998,"5min":7.2149999999999999,"15min":7.2149999999999999},"max":{"1min":38.191000000000003,"5min":235.76599999999999,"15min":235.76599999999999},"last":9.4459999999999997}]},{"osd":7,"last update":"Tue Jan 23 08:10:00 2024","interfaces":[{"interface":"back","average":{"1min":22.579999999999998,"5min":41,"15min":28.344999999999999},"min":{"1min":15.906000000000001,"5min":12.061,"15min":6.9009999999999998},"max":{"1min":39.82,"5min":234.15700000000001,"15min":234.15700000000001},"last":13.494},{"interface":"front","average":{"1min":16.991,"5min":31.675999999999998,"15min":25.094999999999999},"min":{"1min":9.718,"5min":8.4979999999999993,"15min":6.6929999999999996},"max":{"1min":30.414999999999999,"5min":239.101,"15min":246.71799999999999},"last":12.375999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72112,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299728,"statfs":{"total":96636764160,"available":96562921472,"internally_reserved":0,"allocated":4952064,"data_stored":2259859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.843,"5min":21.023,"15min":20.405999999999999},"min":{"1min":6.4370000000000003,"5min":5.6959999999999997,"15min":4.5039999999999996},"max":{"1min":27.398,"5min":168.251,"15min":312.25599999999997},"last":12.209},{"interface":"front","average":{"1min":16.335999999999999,"5min":31.129999999999999,"15min":26.777000000000001},"min":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":5.2380000000000004},"max":{"1min":30.542000000000002,"5min":253.14500000000001,"15min":312.85199999999998},"last":18.143000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.454999999999998,"5min":20.600000000000001,"15min":21.294},"min":{"1min":6.4470000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"max":{"1min":72.905000000000001,"5min":174.38800000000001,"15min":310.94200000000001},"last":17.215},{"interface":"front","average":{"1min":11.943,"5min":19.451000000000001,"15min":24.952999999999999},"min":{"1min":6.5999999999999996,"5min":5.8339999999999996,"15min":5.8339999999999996},"max":{"1min":40.143999999999998,"5min":208.99199999999999,"15min":285.43599999999998},"last":5.8979999999999997}]},{"osd":2,"last update":"Tue Jan 23 08:10:22 2024","interfaces":[{"interface":"back","average":{"1min":15.574,"5min":44.034999999999997,"15min":27.588000000000001},"min":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"max":{"1min":73.838999999999999,"5min":1676.316,"15min":1676.316},"last":10.285},{"interface":"front","average":{"1min":20.335999999999999,"5min":48.231999999999999,"15min":32.299999999999997},"min":{"1min":10.959,"5min":6.6260000000000003,"15min":6.6260000000000003},"max":{"1min":75.010000000000005,"5min":1582.598,"15min":1582.598},"last":14.573}]},{"osd":3,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.201000000000001,"5min":25.422000000000001,"15min":24.648},"min":{"1min":10.119999999999999,"5min":10.119999999999999,"15min":7.8049999999999997},"max":{"1min":33.652000000000001,"5min":138.828,"15min":311.21300000000002},"last":19.074000000000002},{"interface":"front","average":{"1min":20.939,"5min":27.923999999999999,"15min":28.23},"min":{"1min":12.728999999999999,"5min":10.895,"15min":10.42},"max":{"1min":34.484999999999999,"5min":180.071,"15min":313.44200000000001},"last":21.084}]},{"osd":4,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.15,"5min":17.157,"15min":17.864000000000001},"min":{"1min":5.282,"5min":5.2320000000000002,"15min":5.2320000000000002},"max":{"1min":31.683,"5min":163.13399999999999,"15min":355.80000000000001},"last":7.5279999999999996},{"interface":"front","average":{"1min":16.738,"5min":23.565000000000001,"15min":23.312000000000001},"min":{"1min":9.1180000000000003,"5min":6.9829999999999997,"15min":6.9829999999999997},"max":{"1min":29.797999999999998,"5min":172.30799999999999,"15min":331.42500000000001},"last":15.335000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:09:39 2024","interfaces":[{"interface":"back","average":{"1min":23.756,"5min":28.641999999999999,"15min":26.856000000000002},"min":{"1min":8.8849999999999998,"5min":8.5679999999999996,"15min":7.8380000000000001},"max":{"1min":63.781999999999996,"5min":248.00899999999999,"15min":259.23200000000003},"last":27.103000000000002},{"interface":"front","average":{"1min":28.175000000000001,"5min":34.142000000000003,"15min":31.850999999999999},"min":{"1min":15.789999999999999,"5min":9.7319999999999993,"15min":9.7319999999999993},"max":{"1min":79.778999999999996,"5min":249.30099999999999,"15min":278.38400000000001},"last":31.632999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:17 2024","interfaces":[{"interface":"back","average":{"1min":12.960000000000001,"5min":20.105,"15min":21.783999999999999},"min":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1769999999999996},"max":{"1min":38.274000000000001,"5min":167.12100000000001,"15min":343.786},"last":11.462},{"interface":"front","average":{"1min":20.988,"5min":31.399999999999999,"15min":29.193999999999999},"min":{"1min":10.363,"5min":10.363,"15min":10.363},"max":{"1min":68.890000000000001,"5min":186.30199999999999,"15min":302.589},"last":16.449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575295,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72520,"kb_used_data":5240,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299320,"statfs":{"total":96636764160,"available":96562503680,"internally_reserved":0,"allocated":5365760,"data_stored":2664419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":11.755000000000001,"5min":15.83,"15min":17.065000000000001},"min":{"1min":5.0640000000000001,"5min":4.3899999999999997,"15min":4.3849999999999998},"max":{"1min":31.181000000000001,"5min":107.895,"15min":301.08300000000003},"last":8.2520000000000007},{"interface":"front","average":{"1min":13.680999999999999,"5min":15.866,"15min":18.422000000000001},"min":{"1min":6.8079999999999998,"5min":4.46,"15min":4.46},"max":{"1min":44.594000000000001,"5min":112.321,"15min":299.28699999999998},"last":9.875}]},{"osd":1,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":18.789999999999999,"5min":16.811,"15min":21.641999999999999},"min":{"1min":7.4450000000000003,"5min":6.0640000000000001,"15min":6.0640000000000001},"max":{"1min":48.829999999999998,"5min":108.367,"15min":335.601},"last":18.927},{"interface":"front","average":{"1min":15.991,"5min":15.215999999999999,"15min":18.478000000000002},"min":{"1min":6.2990000000000004,"5min":6.2990000000000004,"15min":5.9269999999999996},"max":{"1min":35.363,"5min":95.385000000000005,"15min":338.95499999999998},"last":6.8440000000000003}]},{"osd":2,"last update":"Tue Jan 23 08:10:20 2024","interfaces":[{"interface":"back","average":{"1min":15.198,"5min":20.091999999999999,"15min":22.443000000000001},"min":{"1min":6.915,"5min":6.3940000000000001,"15min":6.2859999999999996},"max":{"1min":39.262999999999998,"5min":122.42700000000001,"15min":280.85399999999998},"last":13.233000000000001},{"interface":"front","average":{"1min":15.127000000000001,"5min":20.622,"15min":23.937999999999999},"min":{"1min":7,"5min":6.7720000000000002,"15min":6.7720000000000002},"max":{"1min":66.775000000000006,"5min":268.779,"15min":307.334},"last":11.913}]},{"osd":3,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":16.997,"5min":19.888999999999999,"15min":27.268000000000001},"min":{"1min":7.5330000000000004,"5min":7.2489999999999997,"15min":7.2489999999999997},"max":{"1min":34.234000000000002,"5min":108.986,"15min":412.625},"last":10.535},{"interface":"front","average":{"1min":16.832000000000001,"5min":20.248000000000001,"15min":25.879999999999999},"min":{"1min":7.306,"5min":7.306,"15min":7.1660000000000004},"max":{"1min":46.414999999999999,"5min":115.22499999999999,"15min":253.58199999999999},"last":8.8810000000000002}]},{"osd":4,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":20.035,"5min":20.260000000000002,"15min":23.454999999999998},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":60.408000000000001,"5min":126.482,"15min":224.07400000000001},"last":13.904999999999999},{"interface":"front","average":{"1min":24.856999999999999,"5min":24.849,"15min":27.280999999999999},"min":{"1min":11.863,"5min":9.5809999999999995,"15min":9.5809999999999995},"max":{"1min":68.748000000000005,"5min":175.51599999999999,"15min":281.10399999999998},"last":14.609}]},{"osd":6,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":15.853,"5min":18.908999999999999,"15min":22.780999999999999},"min":{"1min":8.4540000000000006,"5min":7.5039999999999996,"15min":7.1130000000000004},"max":{"1min":36.344999999999999,"5min":141.524,"15min":338.66300000000001},"last":18.085999999999999},{"interface":"front","average":{"1min":22.779,"5min":24.696999999999999,"15min":28.998999999999999},"min":{"1min":13.907999999999999,"5min":11.093,"15min":10.342000000000001},"max":{"1min":72.058000000000007,"5min":145.38300000000001,"15min":417.69},"last":16.792999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":25.297000000000001,"5min":23.457999999999998,"15min":22.731000000000002},"min":{"1min":12.375,"5min":9.8699999999999992,"15min":7.5039999999999996},"max":{"1min":103.679,"5min":111.083,"15min":244.40100000000001},"last":19.776},{"interface":"front","average":{"1min":18.907,"5min":20.039000000000001,"15min":21.625},"min":{"1min":6.3700000000000001,"5min":6.3700000000000001,"15min":6.3700000000000001},"max":{"1min":67.561000000000007,"5min":112.648,"15min":252.24000000000001},"last":11.304}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:10:25.764 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-23T08:10:25.764 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:10:25.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.868+0000 7fd9d393b640 10 monclient: get_monmap_and_config 2024-01-23T08:10:25.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.868+0000 7fd9d393b640 10 monclient: build_initial_monmap 2024-01-23T08:10:25.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.868+0000 7fd9d393b640 10 monclient: monmap: 2024-01-23T08:10:25.868 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:25.869721+0000 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:25.869721+0000 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:25.869 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 Processor -- start 2024-01-23T08:10:25.871 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 -- start start 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient: init 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient: _add_conns ranks=[2,3,4,1,0] 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc0a96e0 0x7fd9cc0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): picked mon.noname-b con 0x7fd9cc0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fd9cc13f390 0x7fd9cc13f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): picked mon.noname-a con 0x7fd9cc13f390 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd9cc145600 0x7fd9cc145a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): picked mon.noname-c con 0x7fd9cc145600 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:25.872 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc0a9e00 con 0x7fd9cc13f390 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9cc0aac10 con 0x7fd9cc145600 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc13fd30 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.869+0000 7fd9d393b640 10 monclient(hunting): authenticate will time out at 4633.228164s 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d16d7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc0a96e0 0x7fd9cc0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d1ed8640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fd9cc145600 0x7fd9cc145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d16d7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc0a96e0 0x7fd9cc0b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48368/0 (socket says 172.21.15.116:48368) 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d16d7640 1 -- 172.21.15.116:0/76710666 learned_addr learned my addr 172.21.15.116:0/76710666 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d16d7640 10 monclient(hunting): get_auth_request con 0x7fd9cc0a96e0 auth_method 0 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d16d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.873 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d16d7640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d16d7640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d1ed8640 10 monclient(hunting): get_auth_request con 0x7fd9cc145600 auth_method 0 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d1ed8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d1ed8640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.870+0000 7fd9d1ed8640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.871+0000 7fd9d1ed8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.871+0000 7fd9d1ed8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.871+0000 7fd9d1ed8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.871+0000 7fd9d16d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.871+0000 7fd9d16d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.871+0000 7fd9d16d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.872+0000 7fd9d1ed8640 10 monclient(hunting): handle_auth_done global_id 20911 payload 274 2024-01-23T08:10:25.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.872+0000 7fd9d1ed8640 1 -- 172.21.15.116:0/76710666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc0a96e0 msgr2=0x7fd9cc0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:25.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.872+0000 7fd9d1ed8640 1 --2- 172.21.15.116:0/76710666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc0a96e0 0x7fd9cc0b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.872+0000 7fd9d1ed8640 1 -- 172.21.15.116:0/76710666 >> v2:172.21.15.116:3300/0 conn(0x7fd9cc13f390 msgr2=0x7fd9cc13f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:25.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.872+0000 7fd9d1ed8640 1 --2- 172.21.15.116:0/76710666 >> v2:172.21.15.116:3300/0 conn(0x7fd9cc13f390 0x7fd9cc13f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.875 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.873+0000 7fd9d1ed8640 10 monclient: _finish_hunting 0 2024-01-23T08:10:25.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.873+0000 7fd9d1ed8640 1 monclient: found mon.noname-c 2024-01-23T08:10:25.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.873+0000 7fd9d1ed8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:25.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.873+0000 7fd9d1ed8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.873+0000 7fd9d1ed8640 1 -- 172.21.15.116:0/76710666 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc0a9ac0 con 0x7fd9cc145600 2024-01-23T08:10:25.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.875+0000 7fd9d1ed8640 1 --2- 172.21.15.116:0/76710666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc145600 0x7fd9cc145a60 secure :-1 s=READY pgs=5212 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0aa490 tx=0x7fd9c402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf403698c483784e server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:25.880 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 1 -- 172.21.15.116:0/76710666 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c402cbd0 con 0x7fd9cc145600 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: dump: 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.881 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: _finish_auth 0 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 1 -- 172.21.15.116:0/76710666 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c402cd30 con 0x7fd9cc145600 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 5 monclient: authenticate success, global_id 20911 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 1 -- 172.21.15.116:0/76710666 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c402cea0 con 0x7fd9cc145600 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.882 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 4 set_mon_vals no callback set 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9c3fff640 10 monclient: dump: 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 10 monclient: shutdown 2024-01-23T08:10:25.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 1 -- 172.21.15.116:0/76710666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc145600 msgr2=0x7fd9cc145a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 1 --2- 172.21.15.116:0/76710666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc145600 0x7fd9cc145a60 secure :-1 s=READY pgs=5212 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0aa490 tx=0x7fd9c402be20 comp rx=0 tx=0).stop 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 1 -- 172.21.15.116:0/76710666 shutdown_connections 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 1 --2- 172.21.15.116:0/76710666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc145600 0x7fd9cc145a60 unknown :-1 s=CLOSED pgs=5212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 1 --2- 172.21.15.116:0/76710666 >> v2:172.21.15.116:3300/0 conn(0x7fd9cc13f390 0x7fd9cc13f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 1 --2- 172.21.15.116:0/76710666 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc0a96e0 0x7fd9cc0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.879+0000 7fd9d393b640 1 -- 172.21.15.116:0/76710666 >> 172.21.15.116:0/76710666 conn(0x7fd9cc0b7bb0 msgr2=0x7fd9cc0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.880+0000 7fd9d393b640 1 -- 172.21.15.116:0/76710666 shutdown_connections 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.880+0000 7fd9d393b640 1 -- 172.21.15.116:0/76710666 wait complete. 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.880+0000 7fd9d393b640 10 monclient: build_initial_monmap 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.880+0000 7fd9d393b640 10 monclient: monmap: 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:25.884 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.880+0000 7fd9d393b640 1 librados: starting msgr at 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.880+0000 7fd9d393b640 1 librados: starting objecter 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 Processor -- start 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 -- start start 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 librados: setting wanted keys 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 librados: calling monclient init 2024-01-23T08:10:25.885 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient: init 2024-01-23T08:10:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T08:10:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc0a96e0 0x7fd9cc140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): picked mon.noname-b con 0x7fd9cc0a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc13f390 0x7fd9cc1d7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): picked mon.noname-a con 0x7fd9cc13f390 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:25.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc145600 0x7fd9cc1d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): picked mon.noname-c con 0x7fd9cc145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc141620 con 0x7fd9cc13f390 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc1cee60 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9cc136990 con 0x7fd9cc145600 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.881+0000 7fd9d393b640 10 monclient(hunting): authenticate will time out at 4633.239927s 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d1ed8640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc145600 0x7fd9cc1d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d16d7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc0a96e0 0x7fd9cc140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d1ed8640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc145600 0x7fd9cc1d7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48374/0 (socket says 172.21.15.116:48374) 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d16d7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc0a96e0 0x7fd9cc140170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:49156/0 (socket says 172.21.15.116:49156) 2024-01-23T08:10:25.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d1ed8640 1 -- 172.21.15.116:0/4268155840 learned_addr learned my addr 172.21.15.116:0/4268155840 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d1ed8640 10 monclient(hunting): get_auth_request con 0x7fd9cc145600 auth_method 0 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d1ed8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d1ed8640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d1ed8640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d16d7640 10 monclient(hunting): get_auth_request con 0x7fd9cc0a96e0 auth_method 0 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d16d7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d16d7640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.882+0000 7fd9d16d7640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.883+0000 7fd9d16d7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.883+0000 7fd9d16d7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.883+0000 7fd9d16d7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.883+0000 7fd9d1ed8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.883+0000 7fd9d1ed8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:25.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.883+0000 7fd9d1ed8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 10 monclient(hunting): handle_auth_done global_id 20914 payload 824 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 1 -- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc145600 msgr2=0x7fd9cc1d7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc145600 0x7fd9cc1d7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 1 -- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc13f390 msgr2=0x7fd9cc1d7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc13f390 0x7fd9cc1d7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 10 monclient: _finish_hunting 0 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 1 monclient: found mon.noname-b 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.885+0000 7fd9d16d7640 1 -- 172.21.15.116:0/4268155840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c4009a70 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.888+0000 7fd9d16d7640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc0a96e0 0x7fd9cc140170 secure :-1 s=READY pgs=5213 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800e850 tx=0x7fd9c800ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.888+0000 7fd9c1ffb640 10 client.?.objecter ms_handle_connect 0x7fd9cc0a96e0 2024-01-23T08:10:25.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.888+0000 7fd9c1ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 1 -- 172.21.15.116:0/4268155840 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800c940 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: dump: 2024-01-23T08:10:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.893 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 1 -- 172.21.15.116:0/4268155840 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c800caa0 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 5 monclient: authenticate success, global_id 20914 2024-01-23T08:10:25.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 10 monclient: _renew_subs 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9cc1406b0 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 1 -- 172.21.15.116:0/4268155840 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c800ce10 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c1ffb640 10 monclient: dump: 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:25.895 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9c37fe640 4 set_mon_vals no callback set 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 10 client.20914.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 10 monclient: _renew_subs 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9cc1d8490 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.891+0000 7fd9d393b640 1 librados: init done 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.892+0000 7fd9d393b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.892+0000 7fd9d393b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.892+0000 7fd9d393b640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:25.896 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.892+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9cc067d70 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.910+0000 7fd9c1ffb640 1 -- 172.21.15.116:0/4268155840 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fd9c8013470 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.911+0000 7fd9c1ffb640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd9b006c8b0 0x7fd9b006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:25.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.911+0000 7fd9d0ed6640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd9b006c8b0 0x7fd9b006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:25.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.911+0000 7fd9d0ed6640 10 monclient: get_auth_request con 0x7fd9b006c8b0 auth_method 0 2024-01-23T08:10:25.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.911+0000 7fd9c1ffb640 10 client.20914.objecter ms_handle_connect 0x7fd9b006c8b0 2024-01-23T08:10:25.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.911+0000 7fd9d0ed6640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd9b006c8b0 0x7fd9b006ed70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc1414e0 tx=0x7fd9bc006c80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:25.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.913+0000 7fd9c1ffb640 1 -- 172.21.15.116:0/4268155840 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fd9c8058b90 con 0x7fd9cc0a96e0 2024-01-23T08:10:25.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.913+0000 7fd9c1ffb640 10 client.20914.objecter ms_dispatch 0x7fd9cc000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:25.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.913+0000 7fd9c1ffb640 3 client.20914.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:25.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.913+0000 7fd9c1ffb640 3 client.20914.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:25.913 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:25.913+0000 7fd9c1ffb640 20 client.20914.objecter dump_active .. 0 homeless 2024-01-23T08:10:26.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.172+0000 7fd9c1ffb640 1 -- 172.21.15.116:0/4268155840 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fd9c8054ed0 con 0x7fd9cc0a96e0 2024-01-23T08:10:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.172+0000 7fd9c1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:26.173 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.172+0000 7fd9c1ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:26.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.343+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9cc0ab160 con 0x7fd9b006c8b0 2024-01-23T08:10:26.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.348+0000 7fd9c1ffb640 1 -- 172.21.15.116:0/4268155840 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151831 (secure 0 0 0) 0x7fd9bc013410 con 0x7fd9b006c8b0 2024-01-23T08:10:26.350 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T08:10:26.350 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.350+0000 7fd9d393b640 10 librados: watch_flush enter 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.350+0000 7fd9d393b640 10 librados: watch_flush exit 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.350+0000 7fd9d393b640 20 client.20914.objecter shutdown clearing up homeless session... 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.350+0000 7fd9d393b640 10 client.20914.objecter successfully canceled tick 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd9b006c8b0 msgr2=0x7fd9b006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd9b006c8b0 0x7fd9b006ed70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc1414e0 tx=0x7fd9bc006c80 comp rx=0 tx=0).stop 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 10 monclient: shutdown 2024-01-23T08:10:26.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc0a96e0 msgr2=0x7fd9cc140170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc0a96e0 0x7fd9cc140170 secure :-1 s=READY pgs=5213 cs=0 l=1 rev1=1 crypto rx=0x7fd9c800e850 tx=0x7fd9c800ed10 comp rx=0 tx=0).stop 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 shutdown_connections 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fd9b006c8b0 0x7fd9b006ed70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fd9cc145600 0x7fd9cc1d7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd9cc13f390 0x7fd9cc1d7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 --2- 172.21.15.116:0/4268155840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9cc0a96e0 0x7fd9cc140170 unknown :-1 s=CLOSED pgs=5213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 >> 172.21.15.116:0/4268155840 conn(0x7fd9cc0b7bb0 msgr2=0x7fd9cc13a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 shutdown_connections 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 -- 172.21.15.116:0/4268155840 wait complete. 2024-01-23T08:10:26.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.351+0000 7fd9d393b640 1 librados: shutdown 2024-01-23T08:10:26.361 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2441,"stamp":"2024-01-23T08:10:25.798176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":92,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":581904,"kb_used_data":39496,"kb_used_omap":12,"kb_used_meta":542259,"kb_avail":754392816,"statfs":{"total":773094113280,"available":772498243584,"internally_reserved":0,"allocated":40443904,"data_stored":18885866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":555273776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":184,"apply_latency_ms":184,"commit_latency_ns":184000000,"apply_latency_ns":184000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.728482"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":2543,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.918403+0000","last_change":"2024-01-23T07:35:49.772956+0000","last_active":"2024-01-23T08:10:20.918403+0000","last_peered":"2024-01-23T08:10:20.918403+0000","last_clean":"2024-01-23T08:10:20.918403+0000","last_became_active":"2024-01-23T07:35:49.767110+0000","last_became_peered":"2024-01-23T07:35:49.767110+0000","last_unstale":"2024-01-23T08:10:20.918403+0000","last_undegraded":"2024-01-23T08:10:20.918403+0000","last_fullsized":"2024-01-23T08:10:20.918403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:11:19.875803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":2538,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.912573+0000","last_change":"2024-01-23T07:46:17.396184+0000","last_active":"2024-01-23T08:10:20.912573+0000","last_peered":"2024-01-23T08:10:20.912573+0000","last_clean":"2024-01-23T08:10:20.912573+0000","last_became_active":"2024-01-23T07:46:17.386551+0000","last_became_peered":"2024-01-23T07:46:17.386551+0000","last_unstale":"2024-01-23T08:10:20.912573+0000","last_undegraded":"2024-01-23T08:10:20.912573+0000","last_fullsized":"2024-01-23T08:10:20.912573+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:18:07.924980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":2067,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.024512+0000","last_change":"2024-01-23T07:40:37.949256+0000","last_active":"2024-01-23T08:10:23.024512+0000","last_peered":"2024-01-23T08:10:23.024512+0000","last_clean":"2024-01-23T08:10:23.024512+0000","last_became_active":"2024-01-23T07:40:37.943110+0000","last_became_peered":"2024-01-23T07:40:37.943110+0000","last_unstale":"2024-01-23T08:10:23.024512+0000","last_undegraded":"2024-01-23T08:10:23.024512+0000","last_fullsized":"2024-01-23T08:10:23.024512+0000","mapping_epoch":276,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":277,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:47:53.342128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":2536,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.070492+0000","last_change":"2024-01-23T07:35:17.672440+0000","last_active":"2024-01-23T08:10:24.070492+0000","last_peered":"2024-01-23T08:10:24.070492+0000","last_clean":"2024-01-23T08:10:24.070492+0000","last_became_active":"2024-01-23T07:35:17.664344+0000","last_became_peered":"2024-01-23T07:35:17.664344+0000","last_unstale":"2024-01-23T08:10:24.070492+0000","last_undegraded":"2024-01-23T08:10:24.070492+0000","last_fullsized":"2024-01-23T08:10:24.070492+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:29:47.794690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":2534,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.047146+0000","last_change":"2024-01-23T07:35:53.501964+0000","last_active":"2024-01-23T08:10:24.047146+0000","last_peered":"2024-01-23T08:10:24.047146+0000","last_clean":"2024-01-23T08:10:24.047146+0000","last_became_active":"2024-01-23T07:35:53.492743+0000","last_became_peered":"2024-01-23T07:35:53.492743+0000","last_unstale":"2024-01-23T08:10:24.047146+0000","last_undegraded":"2024-01-23T08:10:24.047146+0000","last_fullsized":"2024-01-23T08:10:24.047146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:57:15.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":2533,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.872031+0000","last_change":"2024-01-23T07:46:16.359928+0000","last_active":"2024-01-23T08:10:20.872031+0000","last_peered":"2024-01-23T08:10:20.872031+0000","last_clean":"2024-01-23T08:10:20.872031+0000","last_became_active":"2024-01-23T07:46:16.353670+0000","last_became_peered":"2024-01-23T07:46:16.353670+0000","last_unstale":"2024-01-23T08:10:20.872031+0000","last_undegraded":"2024-01-23T08:10:20.872031+0000","last_fullsized":"2024-01-23T08:10:20.872031+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:55:34.799754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":2534,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.055827+0000","last_change":"2024-01-23T07:35:17.534265+0000","last_active":"2024-01-23T08:10:24.055827+0000","last_peered":"2024-01-23T08:10:24.055827+0000","last_clean":"2024-01-23T08:10:24.055827+0000","last_became_active":"2024-01-23T07:35:17.521909+0000","last_became_peered":"2024-01-23T07:35:17.521909+0000","last_unstale":"2024-01-23T08:10:24.055827+0000","last_undegraded":"2024-01-23T08:10:24.055827+0000","last_fullsized":"2024-01-23T08:10:24.055827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:42:31.245205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":2525,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.884563+0000","last_change":"2024-01-23T07:46:17.614578+0000","last_active":"2024-01-23T08:10:20.884563+0000","last_peered":"2024-01-23T08:10:20.884563+0000","last_clean":"2024-01-23T08:10:20.884563+0000","last_became_active":"2024-01-23T07:46:17.609277+0000","last_became_peered":"2024-01-23T07:46:17.609277+0000","last_unstale":"2024-01-23T08:10:20.884563+0000","last_undegraded":"2024-01-23T08:10:20.884563+0000","last_fullsized":"2024-01-23T08:10:20.884563+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:04:31.637396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":2534,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.065096+0000","last_change":"2024-01-23T07:35:17.515370+0000","last_active":"2024-01-23T08:10:24.065096+0000","last_peered":"2024-01-23T08:10:24.065096+0000","last_clean":"2024-01-23T08:10:24.065096+0000","last_became_active":"2024-01-23T07:35:17.510073+0000","last_became_peered":"2024-01-23T07:35:17.510073+0000","last_unstale":"2024-01-23T08:10:24.065096+0000","last_undegraded":"2024-01-23T08:10:24.065096+0000","last_fullsized":"2024-01-23T08:10:24.065096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:27:19.993768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":2527,"reported_epoch":1320,"state":"active+clean","last_fresh":"2024-01-23T08:10:21.887611+0000","last_change":"2024-01-23T07:35:53.382362+0000","last_active":"2024-01-23T08:10:21.887611+0000","last_peered":"2024-01-23T08:10:21.887611+0000","last_clean":"2024-01-23T08:10:21.887611+0000","last_became_active":"2024-01-23T07:35:53.376441+0000","last_became_peered":"2024-01-23T07:35:53.376441+0000","last_unstale":"2024-01-23T08:10:21.887611+0000","last_undegraded":"2024-01-23T08:10:21.887611+0000","last_fullsized":"2024-01-23T08:10:21.887611+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:51:04.227769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":2558,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.027092+0000","last_change":"2024-01-23T07:35:26.286843+0000","last_active":"2024-01-23T08:10:23.027092+0000","last_peered":"2024-01-23T08:10:23.027092+0000","last_clean":"2024-01-23T08:10:23.027092+0000","last_became_active":"2024-01-23T07:35:26.273730+0000","last_became_peered":"2024-01-23T07:35:26.273730+0000","last_unstale":"2024-01-23T08:10:23.027092+0000","last_undegraded":"2024-01-23T08:10:23.027092+0000","last_fullsized":"2024-01-23T08:10:23.027092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:14:11.669279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":2523,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.915023+0000","last_change":"2024-01-23T07:36:02.469027+0000","last_active":"2024-01-23T08:10:23.915023+0000","last_peered":"2024-01-23T08:10:23.915023+0000","last_clean":"2024-01-23T08:10:23.915023+0000","last_became_active":"2024-01-23T07:36:02.460264+0000","last_became_peered":"2024-01-23T07:36:02.460264+0000","last_unstale":"2024-01-23T08:10:23.915023+0000","last_undegraded":"2024-01-23T08:10:23.915023+0000","last_fullsized":"2024-01-23T08:10:23.915023+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:21:58.260272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'76","reported_seq":2552,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.900423+0000","last_change":"2024-01-23T07:33:26.319611+0000","last_active":"2024-01-23T08:10:23.900423+0000","last_peered":"2024-01-23T08:10:23.900423+0000","last_clean":"2024-01-23T08:10:23.900423+0000","last_became_active":"2024-01-23T07:33:25.600297+0000","last_became_peered":"2024-01-23T07:33:25.600297+0000","last_unstale":"2024-01-23T08:10:23.900423+0000","last_undegraded":"2024-01-23T08:10:23.900423+0000","last_fullsized":"2024-01-23T08:10:23.900423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:13.116593+0000","last_clean_scrub_stamp":"2024-01-23T07:33:13.116593+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:32:26.093374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2556,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.165675+0000","last_change":"2024-01-23T07:33:32.660913+0000","last_active":"2024-01-23T08:10:23.165675+0000","last_peered":"2024-01-23T08:10:23.165675+0000","last_clean":"2024-01-23T08:10:23.165675+0000","last_became_active":"2024-01-23T07:33:32.655848+0000","last_became_peered":"2024-01-23T07:33:32.655848+0000","last_unstale":"2024-01-23T08:10:23.165675+0000","last_undegraded":"2024-01-23T08:10:23.165675+0000","last_fullsized":"2024-01-23T08:10:23.165675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:09:57.469855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":2556,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.013548+0000","last_change":"2024-01-23T07:35:08.880758+0000","last_active":"2024-01-23T08:10:23.013548+0000","last_peered":"2024-01-23T08:10:23.013548+0000","last_clean":"2024-01-23T08:10:23.013548+0000","last_became_active":"2024-01-23T07:35:08.862294+0000","last_became_peered":"2024-01-23T07:35:08.862294+0000","last_unstale":"2024-01-23T08:10:23.013548+0000","last_undegraded":"2024-01-23T08:10:23.013548+0000","last_fullsized":"2024-01-23T08:10:23.013548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:51:07.605185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2556,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.173990+0000","last_change":"2024-01-23T07:33:32.273001+0000","last_active":"2024-01-23T08:10:23.173990+0000","last_peered":"2024-01-23T08:10:23.173990+0000","last_clean":"2024-01-23T08:10:23.173990+0000","last_became_active":"2024-01-23T07:33:32.242199+0000","last_became_peered":"2024-01-23T07:33:32.242199+0000","last_unstale":"2024-01-23T08:10:23.173990+0000","last_undegraded":"2024-01-23T08:10:23.173990+0000","last_fullsized":"2024-01-23T08:10:23.173990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:00:09.885876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":2525,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.930099+0000","last_change":"2024-01-23T07:35:57.074880+0000","last_active":"2024-01-23T08:10:23.930099+0000","last_peered":"2024-01-23T08:10:23.930099+0000","last_clean":"2024-01-23T08:10:23.930099+0000","last_became_active":"2024-01-23T07:35:57.067585+0000","last_became_peered":"2024-01-23T07:35:57.067585+0000","last_unstale":"2024-01-23T08:10:23.930099+0000","last_undegraded":"2024-01-23T08:10:23.930099+0000","last_fullsized":"2024-01-23T08:10:23.930099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:55:33.167910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2546,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.876825+0000","last_change":"2024-01-23T07:46:17.828288+0000","last_active":"2024-01-23T08:10:20.876825+0000","last_peered":"2024-01-23T08:10:20.876825+0000","last_clean":"2024-01-23T08:10:20.876825+0000","last_became_active":"2024-01-23T07:46:17.822757+0000","last_became_peered":"2024-01-23T07:46:17.822757+0000","last_unstale":"2024-01-23T08:10:20.876825+0000","last_undegraded":"2024-01-23T08:10:20.876825+0000","last_fullsized":"2024-01-23T08:10:20.876825+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:16:46.198098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":2534,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.072421+0000","last_change":"2024-01-23T07:35:17.207540+0000","last_active":"2024-01-23T08:10:24.072421+0000","last_peered":"2024-01-23T08:10:24.072421+0000","last_clean":"2024-01-23T08:10:24.072421+0000","last_became_active":"2024-01-23T07:35:17.149780+0000","last_became_peered":"2024-01-23T07:35:17.149780+0000","last_unstale":"2024-01-23T08:10:24.072421+0000","last_undegraded":"2024-01-23T08:10:24.072421+0000","last_fullsized":"2024-01-23T08:10:24.072421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:36:31.573133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2556,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.170971+0000","last_change":"2024-01-23T07:33:32.478085+0000","last_active":"2024-01-23T08:10:23.170971+0000","last_peered":"2024-01-23T08:10:23.170971+0000","last_clean":"2024-01-23T08:10:23.170971+0000","last_became_active":"2024-01-23T07:33:32.468117+0000","last_became_peered":"2024-01-23T07:33:32.468117+0000","last_unstale":"2024-01-23T08:10:23.170971+0000","last_undegraded":"2024-01-23T08:10:23.170971+0000","last_fullsized":"2024-01-23T08:10:23.170971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:53:49.321585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":2562,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.019762+0000","last_change":"2024-01-23T07:46:17.171650+0000","last_active":"2024-01-23T08:10:23.019762+0000","last_peered":"2024-01-23T08:10:23.019762+0000","last_clean":"2024-01-23T08:10:23.019762+0000","last_became_active":"2024-01-23T07:46:17.164304+0000","last_became_peered":"2024-01-23T07:46:17.164304+0000","last_unstale":"2024-01-23T08:10:23.019762+0000","last_undegraded":"2024-01-23T08:10:23.019762+0000","last_fullsized":"2024-01-23T08:10:23.019762+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:47:58.806997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2567,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.016564+0000","last_change":"2024-01-23T07:33:32.481074+0000","last_active":"2024-01-23T08:10:23.016564+0000","last_peered":"2024-01-23T08:10:23.016564+0000","last_clean":"2024-01-23T08:10:23.016564+0000","last_became_active":"2024-01-23T07:33:32.474543+0000","last_became_peered":"2024-01-23T07:33:32.474543+0000","last_unstale":"2024-01-23T08:10:23.016564+0000","last_undegraded":"2024-01-23T08:10:23.016564+0000","last_fullsized":"2024-01-23T08:10:23.016564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:34:40.212856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":2542,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.905321+0000","last_change":"2024-01-23T07:35:28.743786+0000","last_active":"2024-01-23T08:10:20.905321+0000","last_peered":"2024-01-23T08:10:20.905321+0000","last_clean":"2024-01-23T08:10:20.905321+0000","last_became_active":"2024-01-23T07:35:28.738559+0000","last_became_peered":"2024-01-23T07:35:28.738559+0000","last_unstale":"2024-01-23T08:10:20.905321+0000","last_undegraded":"2024-01-23T08:10:20.905321+0000","last_fullsized":"2024-01-23T08:10:20.905321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:43:03.397366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2556,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.183047+0000","last_change":"2024-01-23T07:33:32.371113+0000","last_active":"2024-01-23T08:10:23.183047+0000","last_peered":"2024-01-23T08:10:23.183047+0000","last_clean":"2024-01-23T08:10:23.183047+0000","last_became_active":"2024-01-23T07:33:32.353826+0000","last_became_peered":"2024-01-23T07:33:32.353826+0000","last_unstale":"2024-01-23T08:10:23.183047+0000","last_undegraded":"2024-01-23T08:10:23.183047+0000","last_fullsized":"2024-01-23T08:10:23.183047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:16:09.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":2535,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.051134+0000","last_change":"2024-01-23T07:35:16.873946+0000","last_active":"2024-01-23T08:10:24.051134+0000","last_peered":"2024-01-23T08:10:24.051134+0000","last_clean":"2024-01-23T08:10:24.051134+0000","last_became_active":"2024-01-23T07:35:16.868129+0000","last_became_peered":"2024-01-23T07:35:16.868129+0000","last_unstale":"2024-01-23T08:10:24.051134+0000","last_undegraded":"2024-01-23T08:10:24.051134+0000","last_fullsized":"2024-01-23T08:10:24.051134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:02:37.157717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2551,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.922297+0000","last_change":"2024-01-23T07:33:32.719529+0000","last_active":"2024-01-23T08:10:20.922297+0000","last_peered":"2024-01-23T08:10:20.922297+0000","last_clean":"2024-01-23T08:10:20.922297+0000","last_became_active":"2024-01-23T07:33:32.693171+0000","last_became_peered":"2024-01-23T07:33:32.693171+0000","last_unstale":"2024-01-23T08:10:20.922297+0000","last_undegraded":"2024-01-23T08:10:20.922297+0000","last_fullsized":"2024-01-23T08:10:20.922297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:08:58.102768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":2535,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.045424+0000","last_change":"2024-01-23T07:35:17.021056+0000","last_active":"2024-01-23T08:10:24.045424+0000","last_peered":"2024-01-23T08:10:24.045424+0000","last_clean":"2024-01-23T08:10:24.045424+0000","last_became_active":"2024-01-23T07:35:17.011327+0000","last_became_peered":"2024-01-23T07:35:17.011327+0000","last_unstale":"2024-01-23T08:10:24.045424+0000","last_undegraded":"2024-01-23T08:10:24.045424+0000","last_fullsized":"2024-01-23T08:10:24.045424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:03:58.748267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2554,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.188940+0000","last_change":"2024-01-23T07:33:32.685400+0000","last_active":"2024-01-23T08:10:23.188940+0000","last_peered":"2024-01-23T08:10:23.188940+0000","last_clean":"2024-01-23T08:10:23.188940+0000","last_became_active":"2024-01-23T07:33:32.676672+0000","last_became_peered":"2024-01-23T07:33:32.676672+0000","last_unstale":"2024-01-23T08:10:23.188940+0000","last_undegraded":"2024-01-23T08:10:23.188940+0000","last_fullsized":"2024-01-23T08:10:23.188940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:20:29.458030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":2535,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.038479+0000","last_change":"2024-01-23T07:35:17.450588+0000","last_active":"2024-01-23T08:10:24.038479+0000","last_peered":"2024-01-23T08:10:24.038479+0000","last_clean":"2024-01-23T08:10:24.038479+0000","last_became_active":"2024-01-23T07:35:17.445116+0000","last_became_peered":"2024-01-23T07:35:17.445116+0000","last_unstale":"2024-01-23T08:10:24.038479+0000","last_undegraded":"2024-01-23T08:10:24.038479+0000","last_fullsized":"2024-01-23T08:10:24.038479+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:05:00.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":2554,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.009312+0000","last_change":"2024-01-23T07:35:23.296635+0000","last_active":"2024-01-23T08:10:23.009312+0000","last_peered":"2024-01-23T08:10:23.009312+0000","last_clean":"2024-01-23T08:10:23.009312+0000","last_became_active":"2024-01-23T07:35:23.240102+0000","last_became_peered":"2024-01-23T07:35:23.240102+0000","last_unstale":"2024-01-23T08:10:23.009312+0000","last_undegraded":"2024-01-23T08:10:23.009312+0000","last_fullsized":"2024-01-23T08:10:23.009312+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:44:36.586508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":2503,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.053093+0000","last_change":"2024-01-23T07:36:16.164085+0000","last_active":"2024-01-23T08:10:24.053093+0000","last_peered":"2024-01-23T08:10:24.053093+0000","last_clean":"2024-01-23T08:10:24.053093+0000","last_became_active":"2024-01-23T07:36:16.154523+0000","last_became_peered":"2024-01-23T07:36:16.154523+0000","last_unstale":"2024-01-23T08:10:24.053093+0000","last_undegraded":"2024-01-23T08:10:24.053093+0000","last_fullsized":"2024-01-23T08:10:24.053093+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:42:08.960329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":2537,"reported_epoch":1322,"state":"active+clean","last_fresh":"2024-01-23T08:10:24.040283+0000","last_change":"2024-01-23T07:35:53.515139+0000","last_active":"2024-01-23T08:10:24.040283+0000","last_peered":"2024-01-23T08:10:24.040283+0000","last_clean":"2024-01-23T08:10:24.040283+0000","last_became_active":"2024-01-23T07:35:53.509895+0000","last_became_peered":"2024-01-23T07:35:53.509895+0000","last_unstale":"2024-01-23T08:10:24.040283+0000","last_undegraded":"2024-01-23T08:10:24.040283+0000","last_fullsized":"2024-01-23T08:10:24.040283+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:27:03.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1","version":"115'7","reported_seq":2554,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.169083+0000","last_change":"2024-01-23T07:35:25.280614+0000","last_active":"2024-01-23T08:10:23.169083+0000","last_peered":"2024-01-23T08:10:23.169083+0000","last_clean":"2024-01-23T08:10:23.169083+0000","last_became_active":"2024-01-23T07:35:25.275034+0000","last_became_peered":"2024-01-23T07:35:25.275034+0000","last_unstale":"2024-01-23T08:10:23.169083+0000","last_undegraded":"2024-01-23T08:10:23.169083+0000","last_fullsized":"2024-01-23T08:10:23.169083+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:49:35.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":2527,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.916841+0000","last_change":"2024-01-23T07:35:15.252226+0000","last_active":"2024-01-23T08:10:23.916841+0000","last_peered":"2024-01-23T08:10:23.916841+0000","last_clean":"2024-01-23T08:10:23.916841+0000","last_became_active":"2024-01-23T07:35:15.231845+0000","last_became_peered":"2024-01-23T07:35:15.231845+0000","last_unstale":"2024-01-23T08:10:23.916841+0000","last_undegraded":"2024-01-23T08:10:23.916841+0000","last_fullsized":"2024-01-23T08:10:23.916841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:12:07.791338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":2534,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.897968+0000","last_change":"2024-01-23T07:46:17.147281+0000","last_active":"2024-01-23T08:10:20.897968+0000","last_peered":"2024-01-23T08:10:20.897968+0000","last_clean":"2024-01-23T08:10:20.897968+0000","last_became_active":"2024-01-23T07:46:17.141733+0000","last_became_peered":"2024-01-23T07:46:17.141733+0000","last_unstale":"2024-01-23T08:10:20.897968+0000","last_undegraded":"2024-01-23T08:10:20.897968+0000","last_fullsized":"2024-01-23T08:10:20.897968+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:14:19.035625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":2528,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.909041+0000","last_change":"2024-01-23T07:35:11.695684+0000","last_active":"2024-01-23T08:10:23.909041+0000","last_peered":"2024-01-23T08:10:23.909041+0000","last_clean":"2024-01-23T08:10:23.909041+0000","last_became_active":"2024-01-23T07:35:11.686621+0000","last_became_peered":"2024-01-23T07:35:11.686621+0000","last_unstale":"2024-01-23T08:10:23.909041+0000","last_undegraded":"2024-01-23T08:10:23.909041+0000","last_fullsized":"2024-01-23T08:10:23.909041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:21:41.433898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":2528,"reported_epoch":1320,"state":"active+clean","last_fresh":"2024-01-23T08:10:21.871152+0000","last_change":"2024-01-23T07:35:52.897767+0000","last_active":"2024-01-23T08:10:21.871152+0000","last_peered":"2024-01-23T08:10:21.871152+0000","last_clean":"2024-01-23T08:10:21.871152+0000","last_became_active":"2024-01-23T07:35:52.882762+0000","last_became_peered":"2024-01-23T07:35:52.882762+0000","last_unstale":"2024-01-23T08:10:21.871152+0000","last_undegraded":"2024-01-23T08:10:21.871152+0000","last_fullsized":"2024-01-23T08:10:21.871152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:43:06.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":2522,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.909270+0000","last_change":"2024-01-23T07:35:31.951915+0000","last_active":"2024-01-23T08:10:23.909270+0000","last_peered":"2024-01-23T08:10:23.909270+0000","last_clean":"2024-01-23T08:10:23.909270+0000","last_became_active":"2024-01-23T07:35:31.935370+0000","last_became_peered":"2024-01-23T07:35:31.935370+0000","last_unstale":"2024-01-23T08:10:23.909270+0000","last_undegraded":"2024-01-23T08:10:23.909270+0000","last_fullsized":"2024-01-23T08:10:23.909270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T07:42:47.447343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":2535,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.882381+0000","last_change":"2024-01-23T07:46:17.160020+0000","last_active":"2024-01-23T08:10:20.882381+0000","last_peered":"2024-01-23T08:10:20.882381+0000","last_clean":"2024-01-23T08:10:20.882381+0000","last_became_active":"2024-01-23T07:46:17.153624+0000","last_became_peered":"2024-01-23T07:46:17.153624+0000","last_unstale":"2024-01-23T08:10:20.882381+0000","last_undegraded":"2024-01-23T08:10:20.882381+0000","last_fullsized":"2024-01-23T08:10:20.882381+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T07:45:27.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":2523,"reported_epoch":1321,"state":"active+clean","last_fresh":"2024-01-23T08:10:23.915197+0000","last_change":"2024-01-23T07:35:55.640548+0000","last_active":"2024-01-23T08:10:23.915197+0000","last_peered":"2024-01-23T08:10:23.915197+0000","last_clean":"2024-01-23T08:10:23.915197+0000","last_became_active":"2024-01-23T07:35:55.634625+0000","last_became_peered":"2024-01-23T07:35:55.634625+0000","last_unstale":"2024-01-23T08:10:23.915197+0000","last_undegraded":"2024-01-23T08:10:23.915197+0000","last_fullsized":"2024-01-23T08:10:23.915197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:59:35.575710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":2536,"reported_epoch":1319,"state":"active+clean","last_fresh":"2024-01-23T08:10:20.874291+0000","last_change":"2024-01-23T07:46:17.111555+0000","last_active":"2024-01-23T08:10:20.874291+0000","last_peered":"2024-01-23T08:10:20.874291+0000","last_clean":"2024-01-23T08:10:20.874291+0000","last_became_active":"2024-01-23T07:46:17.105960+0000","last_became_peered":"2024-01-23T07:46:17.105960+0000","last_unstale":"2024-01-23T08:10:20.874291+0000","last_undegraded":"2024-01-23T08:10:20.874291+0000","last_fullsized":"2024-01-23T08:10:20.874291+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:36:28.032265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":19,"seq":81604379073,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72140,"kb_used_data":4852,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299700,"statfs":{"total":96636764160,"available":96562892800,"internally_reserved":0,"allocated":4968448,"data_stored":2266584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":13.061,"5min":24.649999999999999,"15min":18.510999999999999},"min":{"1min":4.6820000000000004,"5min":4.6390000000000002,"15min":4.4500000000000002},"max":{"1min":40.679000000000002,"5min":226.16999999999999,"15min":259.17200000000003},"last":11.352},{"interface":"front","average":{"1min":13.103,"5min":27.594000000000001,"15min":20.172000000000001},"min":{"1min":5.3700000000000001,"5min":4.5830000000000002,"15min":4.5800000000000001},"max":{"1min":32.253999999999998,"5min":335.11099999999999,"15min":335.11099999999999},"last":12.864000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":11.526999999999999,"5min":25.579000000000001,"15min":20.094999999999999},"min":{"1min":4.7089999999999996,"5min":4.7089999999999996,"15min":4.7089999999999996},"max":{"1min":35.301000000000002,"5min":202.30000000000001,"15min":202.30000000000001},"last":7.5300000000000002},{"interface":"front","average":{"1min":17.094999999999999,"5min":27.420999999999999,"15min":23.341999999999999},"min":{"1min":7.7770000000000001,"5min":7.0030000000000001,"15min":6.8550000000000004},"max":{"1min":46.988999999999997,"5min":129.023,"15min":213.935},"last":13.548999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:10:18 2024","interfaces":[{"interface":"back","average":{"1min":17.052,"5min":41.604999999999997,"15min":31.245999999999999},"min":{"1min":7.8029999999999999,"5min":6.6710000000000003,"15min":6.5270000000000001},"max":{"1min":30.015999999999998,"5min":689.02099999999996,"15min":689.02099999999996},"last":16.911000000000001},{"interface":"front","average":{"1min":15.247999999999999,"5min":30.026,"15min":27.16},"min":{"1min":8.3960000000000008,"5min":6.556,"15min":6.556},"max":{"1min":26.483000000000001,"5min":363.96699999999998,"15min":386.762},"last":18.538}]},{"osd":4,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":20.992999999999999,"5min":25.806999999999999,"15min":24.355},"min":{"1min":10.17,"5min":7.8150000000000004,"15min":7.8150000000000004},"max":{"1min":59.957000000000001,"5min":172.78299999999999,"15min":289.80599999999998},"last":17.273},{"interface":"front","average":{"1min":22.202999999999999,"5min":29.404,"15min":28.827999999999999},"min":{"1min":10.856999999999999,"5min":9.9879999999999995,"15min":9.5510000000000002},"max":{"1min":60.607999999999997,"5min":177.40000000000001,"15min":307.245},"last":20.966999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":20.713000000000001,"5min":28.288,"15min":28.074000000000002},"min":{"1min":6.8029999999999999,"5min":6.8029999999999999,"15min":6.8029999999999999},"max":{"1min":44.375,"5min":201.06200000000001,"15min":359.69900000000001},"last":20.016999999999999},{"interface":"front","average":{"1min":23.881,"5min":28.484999999999999,"15min":28.401},"min":{"1min":12.388999999999999,"5min":10.301,"15min":9.407},"max":{"1min":79.674000000000007,"5min":149.059,"15min":334.642},"last":22.715}]},{"osd":6,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":23.018999999999998,"5min":32.515999999999998,"15min":32.387999999999998},"min":{"1min":10.845000000000001,"5min":8.4260000000000002,"15min":8.4260000000000002},"max":{"1min":73.620999999999995,"5min":199.66399999999999,"15min":341.05700000000002},"last":25.276},{"interface":"front","average":{"1min":29.157,"5min":34.218000000000004,"15min":29.725000000000001},"min":{"1min":15.654,"5min":11.496,"15min":6.6390000000000002},"max":{"1min":101.759,"5min":162.982,"15min":334.94600000000003},"last":24.114999999999998}]},{"osd":7,"last update":"Tue Jan 23 08:09:55 2024","interfaces":[{"interface":"back","average":{"1min":14.962999999999999,"5min":23.611000000000001,"15min":25.231000000000002},"min":{"1min":7.3460000000000001,"5min":7.298,"15min":7.2309999999999999},"max":{"1min":63.154000000000003,"5min":191.524,"15min":223.053},"last":14.648},{"interface":"front","average":{"1min":25.978000000000002,"5min":33.332000000000001,"15min":25.420000000000002},"min":{"1min":9.9719999999999995,"5min":8.4459999999999997,"15min":6.9189999999999996},"max":{"1min":99.994,"5min":211.773,"15min":281.75299999999999},"last":26.792000000000002}]}]},{"osd":1,"up_from":19,"seq":81604379072,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72516,"kb_used_data":5240,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299324,"statfs":{"total":96636764160,"available":96562507776,"internally_reserved":0,"allocated":5365760,"data_stored":2664419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:24 2024","interfaces":[{"interface":"back","average":{"1min":10.567,"5min":20.952000000000002,"15min":19.978999999999999},"min":{"1min":6.4989999999999997,"5min":5.4100000000000001,"15min":5.4100000000000001},"max":{"1min":24.219999999999999,"5min":174.22800000000001,"15min":244.16},"last":21.806999999999999},{"interface":"front","average":{"1min":17.425999999999998,"5min":27.312000000000001,"15min":28.744},"min":{"1min":8.5009999999999994,"5min":6.7830000000000004,"15min":6.7830000000000004},"max":{"1min":38.683,"5min":198.155,"15min":260.27800000000002},"last":25.018000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:09:32 2024","interfaces":[{"interface":"back","average":{"1min":15.324,"5min":25.154,"15min":25.584},"min":{"1min":8.266,"5min":8.266,"15min":6.2699999999999996},"max":{"1min":33.029000000000003,"5min":207.15100000000001,"15min":243.33000000000001},"last":24.247},{"interface":"front","average":{"1min":10.833,"5min":18.463000000000001,"15min":25.510999999999999},"min":{"1min":5.6710000000000003,"5min":4.915,"15min":4.915},"max":{"1min":19.279,"5min":167.71199999999999,"15min":366.99700000000001},"last":19.971}]},{"osd":3,"last update":"Tue Jan 23 08:09:46 2024","interfaces":[{"interface":"back","average":{"1min":21.405999999999999,"5min":28.048999999999999,"15min":23.024000000000001},"min":{"1min":8.6920000000000002,"5min":6.0270000000000001,"15min":5.3650000000000002},"max":{"1min":100.602,"5min":291.79300000000001,"15min":291.79300000000001},"last":21.218},{"interface":"front","average":{"1min":21.239000000000001,"5min":20.696000000000002,"15min":25.032},"min":{"1min":6.1360000000000001,"5min":5.3289999999999997,"15min":5.3289999999999997},"max":{"1min":88.227999999999994,"5min":221.50899999999999,"15min":398.98599999999999},"last":26.395}]},{"osd":4,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":23.504999999999999,"5min":30.498000000000001,"15min":32.963000000000001},"min":{"1min":11.525,"5min":8.2940000000000005,"15min":7.641},"max":{"1min":36.862000000000002,"5min":204.095,"15min":572.26999999999998},"last":25.634},{"interface":"front","average":{"1min":12.919,"5min":16.268999999999998,"15min":20.911000000000001},"min":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"max":{"1min":40.198,"5min":78.813000000000002,"15min":411.84399999999999},"last":18.687000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":29.154,"5min":28.667000000000002,"15min":31.228000000000002},"min":{"1min":7.6900000000000004,"5min":7.6900000000000004,"15min":7.6900000000000004},"max":{"1min":106.607,"5min":168.93000000000001,"15min":376.55700000000002},"last":48.158000000000001},{"interface":"front","average":{"1min":29.056000000000001,"5min":26.309999999999999,"15min":27.195},"min":{"1min":7.7670000000000003,"5min":7.7670000000000003,"15min":6.3959999999999999},"max":{"1min":91.256,"5min":173.46899999999999,"15min":364.32600000000002},"last":58.326000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":25.513999999999999,"5min":31.672000000000001,"15min":34.091000000000001},"min":{"1min":15.657999999999999,"5min":10.664,"15min":10.664},"max":{"1min":53.466000000000001,"5min":174.54400000000001,"15min":377.375},"last":27.463999999999999},{"interface":"front","average":{"1min":22.515000000000001,"5min":26.417999999999999,"15min":26.864000000000001},"min":{"1min":9.1940000000000008,"5min":7.0590000000000002,"15min":7.0590000000000002},"max":{"1min":93.706999999999994,"5min":176.499,"15min":248.40000000000001},"last":23.507000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":21.986000000000001,"5min":26.722999999999999,"15min":22.699999999999999},"min":{"1min":9.6899999999999995,"5min":6.8049999999999997,"15min":6.8049999999999997},"max":{"1min":95.328000000000003,"5min":309.55900000000003,"15min":309.55900000000003},"last":28.148},{"interface":"front","average":{"1min":24.766999999999999,"5min":30.609999999999999,"15min":27.841000000000001},"min":{"1min":11.859999999999999,"5min":11.134,"15min":8.3670000000000009},"max":{"1min":98.653000000000006,"5min":169.82300000000001,"15min":245.946},"last":30.239000000000001}]}]},{"osd":4,"up_from":18,"seq":77309411776,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76264,"kb_used_data":4824,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295576,"statfs":{"total":96636764160,"available":96558669824,"internally_reserved":0,"allocated":4939776,"data_stored":2252311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":14.598000000000001,"5min":23.437999999999999,"15min":22.77},"min":{"1min":5.8570000000000002,"5min":5.2850000000000001,"15min":5.2850000000000001},"max":{"1min":98.227999999999994,"5min":371.233,"15min":371.233},"last":13.999000000000001},{"interface":"front","average":{"1min":18.530999999999999,"5min":24.696000000000002,"15min":25.018000000000001},"min":{"1min":7.8490000000000002,"5min":6.1909999999999998,"15min":5.9210000000000003},"max":{"1min":106.56699999999999,"5min":244.11199999999999,"15min":351.55700000000002},"last":15.613}]},{"osd":1,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":25.187000000000001,"5min":25.859999999999999,"15min":26.457999999999998},"min":{"1min":8.4510000000000005,"5min":6.3609999999999998,"15min":5.6040000000000001},"max":{"1min":147.08799999999999,"5min":260.22500000000002,"15min":353.72699999999998},"last":14.852},{"interface":"front","average":{"1min":28.363,"5min":33.558,"15min":32.466999999999999},"min":{"1min":12.493,"5min":10.728999999999999,"15min":7.5830000000000002},"max":{"1min":149.196,"5min":271.54700000000003,"15min":352.48700000000002},"last":18.957999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:09:27 2024","interfaces":[{"interface":"back","average":{"1min":13.788,"5min":47.954999999999998,"15min":30.994},"min":{"1min":5.3090000000000002,"5min":4.5800000000000001,"15min":4.5800000000000001},"max":{"1min":103.143,"5min":2731.4580000000001,"15min":2731.4580000000001},"last":6.9320000000000004},{"interface":"front","average":{"1min":16.902999999999999,"5min":42.124000000000002,"15min":27.620000000000001},"min":{"1min":6.7999999999999998,"5min":6.0640000000000001,"15min":4.6040000000000001},"max":{"1min":75.646000000000001,"5min":1368.422,"15min":1368.422},"last":10.259}]},{"osd":3,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":14.923,"5min":21.501000000000001,"15min":27.437000000000001},"min":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"max":{"1min":92.784999999999997,"5min":185.97900000000001,"15min":367.24000000000001},"last":9.3520000000000003},{"interface":"front","average":{"1min":21.876999999999999,"5min":30.088999999999999,"15min":28.812000000000001},"min":{"1min":12.944000000000001,"5min":10.311,"15min":6.4779999999999998},"max":{"1min":109.018,"5min":502.47000000000003,"15min":502.47000000000003},"last":16.41}]},{"osd":5,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":18.542000000000002,"5min":19.931000000000001,"15min":22.861999999999998},"min":{"1min":5.859,"5min":5.859,"15min":5.859},"max":{"1min":92.823999999999998,"5min":109.624,"15min":482.44299999999998},"last":8.0310000000000006},{"interface":"front","average":{"1min":20.876000000000001,"5min":25.094000000000001,"15min":23.469000000000001},"min":{"1min":8.7230000000000008,"5min":6.1280000000000001,"15min":5.3170000000000002},"max":{"1min":108.36499999999999,"5min":227.20500000000001,"15min":339.04300000000001},"last":12.863}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.561,"5min":25.599,"15min":28.395},"min":{"1min":9.6229999999999993,"5min":7.8109999999999999,"15min":7.8109999999999999},"max":{"1min":110.756,"5min":300.51999999999998,"15min":353.113},"last":12.180999999999999},{"interface":"front","average":{"1min":23.277000000000001,"5min":28.373000000000001,"15min":27.132000000000001},"min":{"1min":12.647,"5min":10.74,"15min":6.8090000000000002},"max":{"1min":109.562,"5min":208.05699999999999,"15min":349.64499999999998},"last":17.225999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":26.695,"5min":34.959000000000003,"15min":32.031999999999996},"min":{"1min":15.186,"5min":7.7939999999999996,"15min":7.3719999999999999},"max":{"1min":116.116,"5min":275.20999999999998,"15min":395.82299999999998},"last":18.023},{"interface":"front","average":{"1min":26.236000000000001,"5min":35.244,"15min":32.054000000000002},"min":{"1min":16.350999999999999,"5min":12.57,"15min":6.4859999999999998},"max":{"1min":124.672,"5min":184.47499999999999,"15min":438.92000000000002},"last":19.739999999999998}]}]},{"osd":7,"up_from":473,"seq":2031519531439,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72080,"kb_used_data":4796,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299760,"statfs":{"total":96636764160,"available":96562954240,"internally_reserved":0,"allocated":4911104,"data_stored":2237576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":10.305999999999999,"5min":22.015000000000001,"15min":16.207999999999998},"min":{"1min":5.8280000000000003,"5min":5.6550000000000002,"15min":4.9550000000000001},"max":{"1min":24.335000000000001,"5min":282.28800000000001,"15min":282.28800000000001},"last":5.5759999999999996},{"interface":"front","average":{"1min":18.126999999999999,"5min":28.951000000000001,"15min":22.047000000000001},"min":{"1min":8.6720000000000006,"5min":7.4989999999999997,"15min":5.476},"max":{"1min":48.290999999999997,"5min":285.887,"15min":285.887},"last":8.3949999999999996}]},{"osd":1,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":15.558999999999999,"5min":18.123999999999999,"15min":18.305},"min":{"1min":6.7359999999999998,"5min":4.8440000000000003,"15min":4.6509999999999998},"max":{"1min":74.322999999999993,"5min":162.80500000000001,"15min":199.09399999999999},"last":9.2300000000000004},{"interface":"front","average":{"1min":15.768000000000001,"5min":25.341999999999999,"15min":22.677},"min":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.1550000000000002},"max":{"1min":86.662000000000006,"5min":238.892,"15min":280.24299999999999},"last":10.464}]},{"osd":2,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.838000000000001,"5min":37.078000000000003,"15min":25.183},"min":{"1min":10.106999999999999,"5min":6.8150000000000004,"15min":5.8129999999999997},"max":{"1min":38.683,"5min":1088.116,"15min":1088.116},"last":18.138999999999999},{"interface":"front","average":{"1min":14.474,"5min":35.444000000000003,"15min":25.821000000000002},"min":{"1min":8.9239999999999995,"5min":6.9080000000000004,"15min":5.2699999999999996},"max":{"1min":34.753,"5min":1187.3219999999999,"15min":1187.3219999999999},"last":12.132999999999999}]},{"osd":3,"last update":"Tue Jan 23 08:10:15 2024","interfaces":[{"interface":"back","average":{"1min":19.507000000000001,"5min":23.98,"15min":22.635999999999999},"min":{"1min":8.1560000000000006,"5min":7.7309999999999999,"15min":6.1749999999999998},"max":{"1min":65.203999999999994,"5min":177.09700000000001,"15min":313.31099999999998},"last":13.205},{"interface":"front","average":{"1min":24.954999999999998,"5min":25.353000000000002,"15min":23.792000000000002},"min":{"1min":9.6549999999999994,"5min":6.3029999999999999,"15min":6.3029999999999999},"max":{"1min":84.671999999999997,"5min":179.13999999999999,"15min":228.626},"last":15.894}]},{"osd":4,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.268000000000001,"5min":25.036000000000001,"15min":23.661000000000001},"min":{"1min":7.444,"5min":6.5149999999999997,"15min":6.4850000000000003},"max":{"1min":64.384,"5min":206.381,"15min":277.70400000000001},"last":11.468999999999999},{"interface":"front","average":{"1min":19.050999999999998,"5min":24.832999999999998,"15min":23.053000000000001},"min":{"1min":10.968,"5min":7.7930000000000001,"15min":7.7930000000000001},"max":{"1min":34.298999999999999,"5min":186.768,"15min":320.26799999999997},"last":16.795000000000002}]},{"osd":5,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":18.742999999999999,"5min":29.033999999999999,"15min":25.672999999999998},"min":{"1min":8.7370000000000001,"5min":8.6809999999999992,"15min":8.0350000000000001},"max":{"1min":29.145,"5min":323.63400000000001,"15min":323.63400000000001},"last":17.513999999999999},{"interface":"front","average":{"1min":20.257000000000001,"5min":29.279,"15min":26.036000000000001},"min":{"1min":6.5529999999999999,"5min":6.5529999999999999,"15min":6.5529999999999999},"max":{"1min":69.991,"5min":263.19799999999998,"15min":263.19799999999998},"last":13.912000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":16.844000000000001,"5min":26.978999999999999,"15min":25.648},"min":{"1min":8.0589999999999993,"5min":7.8849999999999998,"15min":7.1449999999999996},"max":{"1min":36.491,"5min":232.35599999999999,"15min":232.35599999999999},"last":14.664},{"interface":"front","average":{"1min":19.102,"5min":30.035,"15min":26.268000000000001},"min":{"1min":10.395,"5min":7.8029999999999999,"15min":7.4320000000000004},"max":{"1min":29.07,"5min":283.27800000000002,"15min":435.91899999999998},"last":19.350999999999999}]}]},{"osd":2,"up_from":16,"seq":68719477172,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72144,"kb_used_data":4860,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299696,"statfs":{"total":96636764160,"available":96562888704,"internally_reserved":0,"allocated":4976640,"data_stored":2274119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":8.8000000000000007,"5min":27.609999999999999,"15min":18.635999999999999},"min":{"1min":3.9039999999999999,"5min":3.9039999999999999,"15min":3.9039999999999999},"max":{"1min":21.404,"5min":1085.3969999999999,"15min":1085.3969999999999},"last":8.3160000000000007},{"interface":"front","average":{"1min":12.24,"5min":32.030000000000001,"15min":23.178000000000001},"min":{"1min":6.7759999999999998,"5min":5.093,"15min":4.5380000000000003},"max":{"1min":20.372,"5min":938.18899999999996,"15min":938.18899999999996},"last":5.9130000000000003}]},{"osd":1,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":11.996,"5min":22.428999999999998,"15min":22.510999999999999},"min":{"1min":7.5,"5min":5.2000000000000002,"15min":5.0389999999999997},"max":{"1min":27.957000000000001,"5min":281.33499999999998,"15min":310.05200000000002},"last":10.029999999999999},{"interface":"front","average":{"1min":16.562999999999999,"5min":38.578000000000003,"15min":32.250999999999998},"min":{"1min":8.6110000000000007,"5min":6.2220000000000004,"15min":6.2220000000000004},"max":{"1min":27.175999999999998,"5min":969.31899999999996,"15min":969.31899999999996},"last":7.2910000000000004}]},{"osd":3,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":16.364000000000001,"5min":35.424999999999997,"15min":28.559999999999999},"min":{"1min":6.5270000000000001,"5min":6.5270000000000001,"15min":5.9909999999999997},"max":{"1min":79.376000000000005,"5min":1096.0550000000001,"15min":1096.0550000000001},"last":18.805},{"interface":"front","average":{"1min":20.065000000000001,"5min":37.469999999999999,"15min":30.396999999999998},"min":{"1min":9.1189999999999998,"5min":8.782,"15min":8.1910000000000007},"max":{"1min":81.116,"5min":1097.8199999999999,"15min":1097.8199999999999},"last":20.577999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":16.434999999999999,"5min":29.039999999999999,"15min":27.286000000000001},"min":{"1min":7.1500000000000004,"5min":7.1500000000000004,"15min":6.742},"max":{"1min":78.128,"5min":454.44299999999998,"15min":454.44299999999998},"last":10.938000000000001},{"interface":"front","average":{"1min":16.774000000000001,"5min":34.783000000000001,"15min":29.050000000000001},"min":{"1min":8.423,"5min":8.423,"15min":7.5380000000000003},"max":{"1min":25.576000000000001,"5min":1087.472,"15min":1087.472},"last":21.969000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":14.894,"5min":28.713999999999999,"15min":24.637},"min":{"1min":8.1760000000000002,"5min":8.0719999999999992,"15min":8.0719999999999992},"max":{"1min":24.890000000000001,"5min":455.05500000000001,"15min":455.05500000000001},"last":28.541},{"interface":"front","average":{"1min":17.791,"5min":34.188000000000002,"15min":29.135999999999999},"min":{"1min":9.9220000000000006,"5min":9.9220000000000006,"15min":9.1500000000000004},"max":{"1min":28.599,"5min":455.66699999999997,"15min":455.66699999999997},"last":33.380000000000003}]},{"osd":6,"last update":"Tue Jan 23 08:09:25 2024","interfaces":[{"interface":"back","average":{"1min":17.425000000000001,"5min":40.386000000000003,"15min":29.199000000000002},"min":{"1min":9.6199999999999992,"5min":7.6719999999999997,"15min":7.6189999999999998},"max":{"1min":29.992000000000001,"5min":977.35299999999995,"15min":977.35299999999995},"last":14.316000000000001},{"interface":"front","average":{"1min":20.593,"5min":44.506,"15min":32.329000000000001},"min":{"1min":9.0060000000000002,"5min":9.0060000000000002,"15min":9.0060000000000002},"max":{"1min":30.98,"5min":982.83100000000002,"15min":982.83100000000002},"last":16.648}]},{"osd":7,"last update":"Tue Jan 23 08:10:04 2024","interfaces":[{"interface":"back","average":{"1min":27.013000000000002,"5min":50.5,"15min":33.725999999999999},"min":{"1min":11.968,"5min":10.092000000000001,"15min":8.9199999999999999},"max":{"1min":149.69399999999999,"5min":979.63699999999994,"15min":979.63699999999994},"last":15.048999999999999},{"interface":"front","average":{"1min":35.767000000000003,"5min":57.726999999999997,"15min":38.661000000000001},"min":{"1min":15.068,"5min":10.776999999999999,"15min":8.4049999999999994},"max":{"1min":156.78100000000001,"5min":984.54899999999998,"15min":984.54899999999998},"last":17.382000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542590,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72128,"kb_used_data":4848,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299712,"statfs":{"total":96636764160,"available":96562905088,"internally_reserved":0,"allocated":4964352,"data_stored":2266579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":14.076000000000001,"5min":26.460000000000001,"15min":18.937999999999999},"min":{"1min":5.5800000000000001,"5min":5.4349999999999996,"15min":4.6289999999999996},"max":{"1min":58.256999999999998,"5min":240.86000000000001,"15min":259.21699999999998},"last":15.618},{"interface":"front","average":{"1min":20.256,"5min":34.912999999999997,"15min":22.837},"min":{"1min":10.065,"5min":8.3789999999999996,"15min":4.3719999999999999},"max":{"1min":85.894000000000005,"5min":241.94999999999999,"15min":241.94999999999999},"last":19.550000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:09:29 2024","interfaces":[{"interface":"back","average":{"1min":10.087999999999999,"5min":30.771999999999998,"15min":22.111000000000001},"min":{"1min":5.6349999999999998,"5min":5.6349999999999998,"15min":4.8499999999999996},"max":{"1min":22.939,"5min":272.22300000000001,"15min":272.22300000000001},"last":30.334},{"interface":"front","average":{"1min":20.882000000000001,"5min":41.527000000000001,"15min":27.675000000000001},"min":{"1min":10.710000000000001,"5min":8.9939999999999998,"15min":5.8470000000000004},"max":{"1min":37.408999999999999,"5min":272.08100000000002,"15min":328.67500000000001},"last":35.152000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":20.913,"5min":32.823999999999998,"15min":23.902000000000001},"min":{"1min":9.9969999999999999,"5min":6.7539999999999996,"15min":6.7539999999999996},"max":{"1min":40.466999999999999,"5min":205.28700000000001,"15min":205.28700000000001},"last":14.095000000000001},{"interface":"front","average":{"1min":13.377000000000001,"5min":27.677,"15min":21.324000000000002},"min":{"1min":7.2839999999999998,"5min":6.2450000000000001,"15min":6.2450000000000001},"max":{"1min":41.201999999999998,"5min":205.19499999999999,"15min":205.19499999999999},"last":10.047000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.251999999999999,"5min":31.273,"15min":23.646000000000001},"min":{"1min":9.9580000000000002,"5min":7.835,"15min":6.6689999999999996},"max":{"1min":35.313000000000002,"5min":270.214,"15min":270.214},"last":7.8310000000000004},{"interface":"front","average":{"1min":12.816000000000001,"5min":24.617000000000001,"15min":19.789999999999999},"min":{"1min":6.8490000000000002,"5min":6.4409999999999998,"15min":6.0579999999999998},"max":{"1min":27.478999999999999,"5min":206.066,"15min":206.066},"last":7.1959999999999997}]},{"osd":5,"last update":"Tue Jan 23 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":23.785,"5min":39.161000000000001,"15min":28.478000000000002},"min":{"1min":14.23,"5min":10.859,"15min":7.3689999999999998},"max":{"1min":83.944000000000003,"5min":266.38900000000001,"15min":269.887},"last":11.551},{"interface":"front","average":{"1min":17.472999999999999,"5min":25.440999999999999,"15min":22.010999999999999},"min":{"1min":8.0150000000000006,"5min":6.5090000000000003,"15min":5.431},"max":{"1min":76.481999999999999,"5min":267.16199999999998,"15min":267.16199999999998},"last":8.5350000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.571000000000002,"5min":35.337000000000003,"15min":28.390000000000001},"min":{"1min":8.4410000000000007,"5min":8.4410000000000007,"15min":8.2970000000000006},"max":{"1min":38.991,"5min":306.05900000000003,"15min":306.05900000000003},"last":15.032},{"interface":"front","average":{"1min":16.009,"5min":29.239000000000001,"15min":25.030000000000001},"min":{"1min":7.5499999999999998,"5min":7.2149999999999999,"15min":7.2149999999999999},"max":{"1min":38.191000000000003,"5min":235.76599999999999,"15min":235.76599999999999},"last":9.4459999999999997}]},{"osd":7,"last update":"Tue Jan 23 08:10:00 2024","interfaces":[{"interface":"back","average":{"1min":22.579999999999998,"5min":41,"15min":28.344999999999999},"min":{"1min":15.906000000000001,"5min":12.061,"15min":6.9009999999999998},"max":{"1min":39.82,"5min":234.15700000000001,"15min":234.15700000000001},"last":13.494},{"interface":"front","average":{"1min":16.991,"5min":31.675999999999998,"15min":25.094999999999999},"min":{"1min":9.718,"5min":8.4979999999999993,"15min":6.6929999999999996},"max":{"1min":30.414999999999999,"5min":239.101,"15min":246.71799999999999},"last":12.375999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575294,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72112,"kb_used_data":4836,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299728,"statfs":{"total":96636764160,"available":96562921472,"internally_reserved":0,"allocated":4952064,"data_stored":2259859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.843,"5min":21.023,"15min":20.405999999999999},"min":{"1min":6.4370000000000003,"5min":5.6959999999999997,"15min":4.5039999999999996},"max":{"1min":27.398,"5min":168.251,"15min":312.25599999999997},"last":12.209},{"interface":"front","average":{"1min":16.335999999999999,"5min":31.129999999999999,"15min":26.777000000000001},"min":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":5.2380000000000004},"max":{"1min":30.542000000000002,"5min":253.14500000000001,"15min":312.85199999999998},"last":18.143000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.454999999999998,"5min":20.600000000000001,"15min":21.294},"min":{"1min":6.4470000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"max":{"1min":72.905000000000001,"5min":174.38800000000001,"15min":310.94200000000001},"last":17.215},{"interface":"front","average":{"1min":11.943,"5min":19.451000000000001,"15min":24.952999999999999},"min":{"1min":6.5999999999999996,"5min":5.8339999999999996,"15min":5.8339999999999996},"max":{"1min":40.143999999999998,"5min":208.99199999999999,"15min":285.43599999999998},"last":5.8979999999999997}]},{"osd":2,"last update":"Tue Jan 23 08:10:22 2024","interfaces":[{"interface":"back","average":{"1min":15.574,"5min":44.034999999999997,"15min":27.588000000000001},"min":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"max":{"1min":73.838999999999999,"5min":1676.316,"15min":1676.316},"last":10.285},{"interface":"front","average":{"1min":20.335999999999999,"5min":48.231999999999999,"15min":32.299999999999997},"min":{"1min":10.959,"5min":6.6260000000000003,"15min":6.6260000000000003},"max":{"1min":75.010000000000005,"5min":1582.598,"15min":1582.598},"last":14.573}]},{"osd":3,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.201000000000001,"5min":25.422000000000001,"15min":24.648},"min":{"1min":10.119999999999999,"5min":10.119999999999999,"15min":7.8049999999999997},"max":{"1min":33.652000000000001,"5min":138.828,"15min":311.21300000000002},"last":19.074000000000002},{"interface":"front","average":{"1min":20.939,"5min":27.923999999999999,"15min":28.23},"min":{"1min":12.728999999999999,"5min":10.895,"15min":10.42},"max":{"1min":34.484999999999999,"5min":180.071,"15min":313.44200000000001},"last":21.084}]},{"osd":4,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.15,"5min":17.157,"15min":17.864000000000001},"min":{"1min":5.282,"5min":5.2320000000000002,"15min":5.2320000000000002},"max":{"1min":31.683,"5min":163.13399999999999,"15min":355.80000000000001},"last":7.5279999999999996},{"interface":"front","average":{"1min":16.738,"5min":23.565000000000001,"15min":23.312000000000001},"min":{"1min":9.1180000000000003,"5min":6.9829999999999997,"15min":6.9829999999999997},"max":{"1min":29.797999999999998,"5min":172.30799999999999,"15min":331.42500000000001},"last":15.335000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:09:39 2024","interfaces":[{"interface":"back","average":{"1min":23.756,"5min":28.641999999999999,"15min":26.856000000000002},"min":{"1min":8.8849999999999998,"5min":8.5679999999999996,"15min":7.8380000000000001},"max":{"1min":63.781999999999996,"5min":248.00899999999999,"15min":259.23200000000003},"last":27.103000000000002},{"interface":"front","average":{"1min":28.175000000000001,"5min":34.142000000000003,"15min":31.850999999999999},"min":{"1min":15.789999999999999,"5min":9.7319999999999993,"15min":9.7319999999999993},"max":{"1min":79.778999999999996,"5min":249.30099999999999,"15min":278.38400000000001},"last":31.632999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:17 2024","interfaces":[{"interface":"back","average":{"1min":12.960000000000001,"5min":20.105,"15min":21.783999999999999},"min":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1769999999999996},"max":{"1min":38.274000000000001,"5min":167.12100000000001,"15min":343.786},"last":11.462},{"interface":"front","average":{"1min":20.988,"5min":31.399999999999999,"15min":29.193999999999999},"min":{"1min":10.363,"5min":10.363,"15min":10.363},"max":{"1min":68.890000000000001,"5min":186.30199999999999,"15min":302.589},"last":16.449999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575295,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72520,"kb_used_data":5240,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299320,"statfs":{"total":96636764160,"available":96562503680,"internally_reserved":0,"allocated":5365760,"data_stored":2664419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,1],"upper_bound":2048},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":11.755000000000001,"5min":15.83,"15min":17.065000000000001},"min":{"1min":5.0640000000000001,"5min":4.3899999999999997,"15min":4.3849999999999998},"max":{"1min":31.181000000000001,"5min":107.895,"15min":301.08300000000003},"last":8.2520000000000007},{"interface":"front","average":{"1min":13.680999999999999,"5min":15.866,"15min":18.422000000000001},"min":{"1min":6.8079999999999998,"5min":4.46,"15min":4.46},"max":{"1min":44.594000000000001,"5min":112.321,"15min":299.28699999999998},"last":9.875}]},{"osd":1,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":18.789999999999999,"5min":16.811,"15min":21.641999999999999},"min":{"1min":7.4450000000000003,"5min":6.0640000000000001,"15min":6.0640000000000001},"max":{"1min":48.829999999999998,"5min":108.367,"15min":335.601},"last":18.927},{"interface":"front","average":{"1min":15.991,"5min":15.215999999999999,"15min":18.478000000000002},"min":{"1min":6.2990000000000004,"5min":6.2990000000000004,"15min":5.9269999999999996},"max":{"1min":35.363,"5min":95.385000000000005,"15min":338.95499999999998},"last":6.8440000000000003}]},{"osd":2,"last update":"Tue Jan 23 08:10:20 2024","interfaces":[{"interface":"back","average":{"1min":15.198,"5min":20.091999999999999,"15min":22.443000000000001},"min":{"1min":6.915,"5min":6.3940000000000001,"15min":6.2859999999999996},"max":{"1min":39.262999999999998,"5min":122.42700000000001,"15min":280.85399999999998},"last":13.233000000000001},{"interface":"front","average":{"1min":15.127000000000001,"5min":20.622,"15min":23.937999999999999},"min":{"1min":7,"5min":6.7720000000000002,"15min":6.7720000000000002},"max":{"1min":66.775000000000006,"5min":268.779,"15min":307.334},"last":11.913}]},{"osd":3,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":16.997,"5min":19.888999999999999,"15min":27.268000000000001},"min":{"1min":7.5330000000000004,"5min":7.2489999999999997,"15min":7.2489999999999997},"max":{"1min":34.234000000000002,"5min":108.986,"15min":412.625},"last":10.535},{"interface":"front","average":{"1min":16.832000000000001,"5min":20.248000000000001,"15min":25.879999999999999},"min":{"1min":7.306,"5min":7.306,"15min":7.1660000000000004},"max":{"1min":46.414999999999999,"5min":115.22499999999999,"15min":253.58199999999999},"last":8.8810000000000002}]},{"osd":4,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":20.035,"5min":20.260000000000002,"15min":23.454999999999998},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":60.408000000000001,"5min":126.482,"15min":224.07400000000001},"last":13.904999999999999},{"interface":"front","average":{"1min":24.856999999999999,"5min":24.849,"15min":27.280999999999999},"min":{"1min":11.863,"5min":9.5809999999999995,"15min":9.5809999999999995},"max":{"1min":68.748000000000005,"5min":175.51599999999999,"15min":281.10399999999998},"last":14.609}]},{"osd":6,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":15.853,"5min":18.908999999999999,"15min":22.780999999999999},"min":{"1min":8.4540000000000006,"5min":7.5039999999999996,"15min":7.1130000000000004},"max":{"1min":36.344999999999999,"5min":141.524,"15min":338.66300000000001},"last":18.085999999999999},{"interface":"front","average":{"1min":22.779,"5min":24.696999999999999,"15min":28.998999999999999},"min":{"1min":13.907999999999999,"5min":11.093,"15min":10.342000000000001},"max":{"1min":72.058000000000007,"5min":145.38300000000001,"15min":417.69},"last":16.792999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":25.297000000000001,"5min":23.457999999999998,"15min":22.731000000000002},"min":{"1min":12.375,"5min":9.8699999999999992,"15min":7.5039999999999996},"max":{"1min":103.679,"5min":111.083,"15min":244.40100000000001},"last":19.776},{"interface":"front","average":{"1min":18.907,"5min":20.039000000000001,"15min":21.625},"min":{"1min":6.3700000000000001,"5min":6.3700000000000001,"15min":6.3700000000000001},"max":{"1min":67.561000000000007,"5min":112.648,"15min":252.24000000000001},"last":11.304}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:10:26.364 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-23T08:10:26.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.465+0000 7f270f467640 10 monclient: get_monmap_and_config 2024-01-23T08:10:26.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.465+0000 7f270f467640 10 monclient: build_initial_monmap 2024-01-23T08:10:26.465 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.465+0000 7f270f467640 10 monclient: monmap: 2024-01-23T08:10:26.465 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:26.465 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:26.465 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:26.466489+0000 2024-01-23T08:10:26.465 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:26.466489+0000 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:26.466 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:26.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.465+0000 7f270f467640 1 Processor -- start 2024-01-23T08:10:26.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 1 -- start start 2024-01-23T08:10:26.468 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient: init 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient: _add_conns ranks=[4,3,1,2,0] 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f27080a96e0 0x7f27081427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient(hunting): picked mon.noname-c con 0x7f27080a96e0 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f27080a9ac0 0x7f270813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient(hunting): picked mon.noname-a con 0x7f27080a9ac0 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f27080b25b0 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27080aa880 con 0x7f27080b25b0 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080aaad0 con 0x7f27080a9ac0 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080aadb0 con 0x7f27080a96e0 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:26.469 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.466+0000 7f270f467640 10 monclient(hunting): authenticate will time out at 4633.824904s 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270d203640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f27080a96e0 0x7f27081427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270ca02640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f27080a9ac0 0x7f270813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270d203640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f27080a96e0 0x7f27081427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:49164/0 (socket says 172.21.15.116:49164) 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270d203640 1 -- 172.21.15.116:0/3114485901 learned_addr learned my addr 172.21.15.116:0/3114485901 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270d203640 10 monclient(hunting): get_auth_request con 0x7f27080a96e0 auth_method 0 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270d203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270d203640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270d203640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270ca02640 10 monclient(hunting): get_auth_request con 0x7f27080a9ac0 auth_method 0 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270ca02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270ca02640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.467+0000 7f270ca02640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.468+0000 7f270ca02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:26.470 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.468+0000 7f270ca02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:26.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.468+0000 7f270ca02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:26.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.468+0000 7f270d203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:26.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.468+0000 7f270d203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:26.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.468+0000 7f270d203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:26.471 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 10 monclient(hunting): handle_auth_done global_id 16515 payload 274 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 1 -- 172.21.15.116:0/3114485901 >> v2:172.21.15.173:3300/0 conn(0x7f27080a96e0 msgr2=0x7f27081427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 1 --2- 172.21.15.116:0/3114485901 >> v2:172.21.15.173:3300/0 conn(0x7f27080a96e0 0x7f27081427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 1 -- 172.21.15.116:0/3114485901 >> v1:172.21.15.173:6789/0 conn(0x7f27080b25b0 legacy=0x7f27081456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 10 monclient: _finish_hunting 0 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 1 monclient: found mon.noname-a 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.469+0000 7f270ca02640 1 -- 172.21.15.116:0/3114485901 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080ab090 con 0x7f27080a9ac0 2024-01-23T08:10:26.472 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.471+0000 7f270ca02640 1 --2- 172.21.15.116:0/3114485901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080a9ac0 0x7f270813f420 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f27080b7ac0 tx=0x7f26f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5ddf341a5cd1b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:26.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 1 -- 172.21.15.116:0/3114485901 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8031830 con 0x7f27080a9ac0 2024-01-23T08:10:26.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:26.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:26.475 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: dump: 2024-01-23T08:10:26.475 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:26.475 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: _finish_auth 0 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 1 -- 172.21.15.116:0/3114485901 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f8031990 con 0x7f27080a9ac0 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:26.476 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 1 -- 172.21.15.116:0/3114485901 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8031d20 con 0x7f27080a9ac0 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f270f467640 5 monclient: authenticate success, global_id 16515 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f270f467640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f270f467640 4 set_mon_vals no callback set 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.475+0000 7f26fffff640 10 monclient: dump: 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:26.477 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:26.478 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:26.478 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:26.478 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:26.483 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 10 monclient: shutdown 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 -- 172.21.15.116:0/3114485901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080a9ac0 msgr2=0x7f270813f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 --2- 172.21.15.116:0/3114485901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080a9ac0 0x7f270813f420 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f27080b7ac0 tx=0x7f26f802b8d0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 -- 172.21.15.116:0/3114485901 shutdown_connections 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 --2- 172.21.15.116:0/3114485901 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080a9ac0 0x7f270813f420 unknown :-1 s=CLOSED pgs=3238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 --2- 172.21.15.116:0/3114485901 >> v2:172.21.15.173:3300/0 conn(0x7f27080a96e0 0x7f27081427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 -- 172.21.15.116:0/3114485901 >> 172.21.15.116:0/3114485901 conn(0x7f27080b7bb0 msgr2=0x7f27080b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 -- 172.21.15.116:0/3114485901 shutdown_connections 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 1 -- 172.21.15.116:0/3114485901 wait complete. 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 10 monclient: build_initial_monmap 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.476+0000 7f270f467640 10 monclient: monmap: 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:26.484 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 librados: starting msgr at 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 librados: starting objecter 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 Processor -- start 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 -- start start 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 librados: setting wanted keys 2024-01-23T08:10:26.485 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 librados: calling monclient init 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient: init 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27080a96e0 0x7f270813af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): picked mon.noname-c con 0x7f27080a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27080a9ac0 0x7f2708145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): picked mon.noname-b con 0x7f27080a9ac0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080b25b0 0x7f27081434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): picked mon.noname-a con 0x7f27080b25b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2708145440 con 0x7f27080b25b0 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27081461c0 con 0x7f27080a9ac0 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:26.486 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2708145da0 con 0x7f27080a96e0 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.477+0000 7f270f467640 10 monclient(hunting): authenticate will time out at 4633.836070s 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270da04640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080b25b0 0x7f27081434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270ca02640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27080a9ac0 0x7f2708145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270d203640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27080a96e0 0x7f270813af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270da04640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080b25b0 0x7f27081434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33762/0 (socket says 172.21.15.116:33762) 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270da04640 1 -- 172.21.15.116:0/398965350 learned_addr learned my addr 172.21.15.116:0/398965350 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270da04640 10 monclient(hunting): get_auth_request con 0x7f27080b25b0 auth_method 0 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270da04640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270da04640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270da04640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270ca02640 10 monclient(hunting): get_auth_request con 0x7f27080a9ac0 auth_method 0 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270ca02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270ca02640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:26.487 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270ca02640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270d203640 10 monclient(hunting): get_auth_request con 0x7f27080a96e0 auth_method 0 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270d203640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270d203640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.478+0000 7f270d203640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270da04640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270da04640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270da04640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270ca02640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270ca02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270ca02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270d203640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270d203640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:26.488 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.479+0000 7f270d203640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 10 monclient(hunting): handle_auth_done global_id 20920 payload 824 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 1 -- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27080a96e0 msgr2=0x7f270813af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27080a96e0 0x7f270813af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 1 -- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080b25b0 msgr2=0x7f27081434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080b25b0 0x7f27081434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 10 monclient: _finish_hunting 0 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 1 monclient: found mon.noname-b 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270ca02640 1 -- 172.21.15.116:0/398965350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f80093a0 con 0x7f27080a9ac0 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.481+0000 7f270da04640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080b25b0 0x7f27081434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.484+0000 7f270ca02640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27080a9ac0 0x7f2708145860 secure :-1 s=READY pgs=5215 cs=0 l=1 rev1=1 crypto rx=0x7f26f8033000 tx=0x7f26f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.484+0000 7f26fdffb640 10 client.?.objecter ms_handle_connect 0x7f27080a9ac0 2024-01-23T08:10:26.489 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.484+0000 7f26fdffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 1 -- 172.21.15.116:0/398965350 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f803a6f0 con 0x7f27080a9ac0 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: dump: 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:26.491 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 1 -- 172.21.15.116:0/398965350 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f803a890 con 0x7f27080a9ac0 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 1 -- 172.21.15.116:0/398965350 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f803ac40 con 0x7f27080a9ac0 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 5 monclient: authenticate success, global_id 20920 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 10 monclient: _renew_subs 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27081439e0 con 0x7f27080a9ac0 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:26.492 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26ff7fe640 4 set_mon_vals no callback set 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f26fdffb640 10 monclient: dump: 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 10 client.20920.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 10 monclient: _renew_subs 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:26.493 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2708143e60 con 0x7f27080a9ac0 2024-01-23T08:10:26.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.487+0000 7f270f467640 1 librados: init done 2024-01-23T08:10:26.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.488+0000 7f270f467640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:26.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.488+0000 7f270f467640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:26.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.488+0000 7f270f467640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:26.494 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.488+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2708067d70 con 0x7f27080a9ac0 2024-01-23T08:10:26.507 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.507+0000 7f26fdffb640 1 -- 172.21.15.116:0/398965350 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f26f8043410 con 0x7f27080a9ac0 2024-01-23T08:10:26.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.508+0000 7f26fdffb640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f26ec06c8b0 0x7f26ec06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:26.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.508+0000 7f270d203640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f26ec06c8b0 0x7f26ec06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:26.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.508+0000 7f270d203640 10 monclient: get_auth_request con 0x7f26ec06c8b0 auth_method 0 2024-01-23T08:10:26.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.508+0000 7f26fdffb640 10 client.20920.objecter ms_handle_connect 0x7f26ec06c8b0 2024-01-23T08:10:26.508 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.508+0000 7f270d203640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f26ec06c8b0 0x7f26ec06ed70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2704009bd0 tx=0x7f2704009240 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:26.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.745+0000 7f26fdffb640 1 -- 172.21.15.116:0/398965350 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f26f807a6e0 con 0x7f27080a9ac0 2024-01-23T08:10:26.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.745+0000 7f26fdffb640 10 client.20920.objecter ms_dispatch 0x7f2708000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:26.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.745+0000 7f26fdffb640 3 client.20920.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:26.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.745+0000 7f26fdffb640 3 client.20920.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:26.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.745+0000 7f26fdffb640 20 client.20920.objecter dump_active .. 0 homeless 2024-01-23T08:10:26.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.754+0000 7f26fdffb640 1 -- 172.21.15.116:0/398965350 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f26f8076a20 con 0x7f27080a9ac0 2024-01-23T08:10:26.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.754+0000 7f26fdffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:26.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.754+0000 7f26fdffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:26.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.947+0000 7f270f467640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-01-23T08:10:26.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.948+0000 7f270f467640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T08:10:26.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.948+0000 7f270f467640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:26.948 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.948+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2708146020 con 0x7f27080a9ac0 2024-01-23T08:10:26.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.984+0000 7f26fdffb640 1 -- 172.21.15.116:0/398965350 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v1323) v1 ==== 74+0+17752 (secure 0 0 0) 0x7f2708146020 con 0x7f27080a9ac0 2024-01-23T08:10:26.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.984+0000 7f26fdffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-01-23T08:10:26.984 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.984+0000 7f26fdffb640 10 monclient: _finish_command 2 = system:0 2024-01-23T08:10:26.985 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T08:10:26.985 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1323,"fsid":"6d11e51e-733b-4e2c-8640-454d4ffd488c","created":"2024-01-23T07:32:27.826983+0000","modified":"2024-01-23T08:10:25.713468+0000","last_up_change":"2024-01-23T07:46:14.436797+0000","last_in_change":"2024-01-23T07:32:33.359618+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":119,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":341,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-23T07:33:12.781798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-01-23T07:33:29.906428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-01-23T07:34:54.667575+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"605eb632-aafd-48cf-8ee1-87217823fcc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":1317,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6803","nonce":950064745}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6805","nonce":950064745}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6809","nonce":950064745}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":950064745},{"type":"v1","addr":"172.21.15.116:6807","nonce":950064745}]},"public_addr":"172.21.15.116:6803/950064745","cluster_addr":"172.21.15.116:6805/950064745","heartbeat_back_addr":"172.21.15.116:6809/950064745","heartbeat_front_addr":"172.21.15.116:6807/950064745","state":["exists","up"]},{"osd":1,"uuid":"9460f714-f021-407b-964f-20aef6850158","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":1303,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6811","nonce":745967066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6813","nonce":745967066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6817","nonce":745967066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":745967066},{"type":"v1","addr":"172.21.15.116:6815","nonce":745967066}]},"public_addr":"172.21.15.116:6811/745967066","cluster_addr":"172.21.15.116:6813/745967066","heartbeat_back_addr":"172.21.15.116:6817/745967066","heartbeat_front_addr":"172.21.15.116:6815/745967066","state":["exists","up"]},{"osd":2,"uuid":"407697c5-26b5-4614-aeba-2c970b770631","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":1310,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6827","nonce":2848377313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6829","nonce":2848377313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6833","nonce":2848377313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":2848377313},{"type":"v1","addr":"172.21.15.116:6831","nonce":2848377313}]},"public_addr":"172.21.15.116:6827/2848377313","cluster_addr":"172.21.15.116:6829/2848377313","heartbeat_back_addr":"172.21.15.116:6833/2848377313","heartbeat_front_addr":"172.21.15.116:6831/2848377313","state":["exists","up"]},{"osd":3,"uuid":"9d99808b-6196-45a8-893e-5c5f192a7788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":1317,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6819","nonce":1332739445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6821","nonce":1332739445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6825","nonce":1332739445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":1332739445},{"type":"v1","addr":"172.21.15.116:6823","nonce":1332739445}]},"public_addr":"172.21.15.116:6819/1332739445","cluster_addr":"172.21.15.116:6821/1332739445","heartbeat_back_addr":"172.21.15.116:6825/1332739445","heartbeat_front_addr":"172.21.15.116:6823/1332739445","state":["exists","up"]},{"osd":4,"uuid":"991b5dca-bb22-4f89-9209-1facdeb4465c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":1317,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6807","nonce":3961996474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6811","nonce":3961996474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6815","nonce":3961996474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":3961996474},{"type":"v1","addr":"172.21.15.173:6813","nonce":3961996474}]},"public_addr":"172.21.15.173:6807/3961996474","cluster_addr":"172.21.15.173:6811/3961996474","heartbeat_back_addr":"172.21.15.173:6815/3961996474","heartbeat_front_addr":"172.21.15.173:6813/3961996474","state":["exists","up"]},{"osd":5,"uuid":"dba9e892-ba26-4aef-9e65-c923978b44d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":1317,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6801","nonce":1137022367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6803","nonce":1137022367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6809","nonce":1137022367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":1137022367},{"type":"v1","addr":"172.21.15.173:6805","nonce":1137022367}]},"public_addr":"172.21.15.173:6801/1137022367","cluster_addr":"172.21.15.173:6803/1137022367","heartbeat_back_addr":"172.21.15.173:6809/1137022367","heartbeat_front_addr":"172.21.15.173:6805/1137022367","state":["exists","up"]},{"osd":6,"uuid":"94e52b13-76ee-4bb4-b205-3cdcd0b70319","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":1317,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6817","nonce":548415989}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6819","nonce":548415989}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6823","nonce":548415989}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":548415989},{"type":"v1","addr":"172.21.15.173:6821","nonce":548415989}]},"public_addr":"172.21.15.173:6817/548415989","cluster_addr":"172.21.15.173:6819/548415989","heartbeat_back_addr":"172.21.15.173:6823/548415989","heartbeat_front_addr":"172.21.15.173:6821/548415989","state":["exists","up"]},{"osd":7,"uuid":"6dd94ed7-0c7a-495d-a5da-777bce3c00ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":15,"last_clean_end":472,"up_from":473,"up_thru":1317,"down_at":469,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6825","nonce":1205985563}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":1206985563},{"type":"v1","addr":"172.21.15.173:6833","nonce":1206985563}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6831","nonce":1205985563}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":1205985563},{"type":"v1","addr":"172.21.15.173:6829","nonce":1205985563}]},"public_addr":"172.21.15.173:6825/1205985563","cluster_addr":"172.21.15.173:6833/1206985563","heartbeat_back_addr":"172.21.15.173:6831/1205985563","heartbeat_front_addr":"172.21.15.173:6829/1205985563","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.751411+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.227879+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.226283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:12.349783+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.990738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.105254+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:10.482296+0000","dead_epoch":0},{"osd":7,"down_stamp":"2024-01-23T07:46:10.109760+0000","laggy_probability":0.30000001192092896,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-23T07:33:11.067044+0000","dead_epoch":471}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.7","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":4,"length":1}]},{"pool":10,"snaps":[{"begin":5,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":1}]},{"pool":76,"snaps":[{"begin":1,"length":1}]},{"pool":96,"snaps":[{"begin":1,"length":1}]},{"pool":98,"snaps":[{"begin":7,"length":2}]},{"pool":114,"snaps":[{"begin":1,"length":2}]},{"pool":120,"snaps":[{"begin":3,"length":1}]},{"pool":122,"snaps":[{"begin":2,"length":2}]},{"pool":127,"snaps":[{"begin":3,"length":2}]},{"pool":129,"snaps":[{"begin":2,"length":3}]},{"pool":141,"snaps":[{"begin":2,"length":2}]},{"pool":144,"snaps":[{"begin":4,"length":2}]},{"pool":155,"snaps":[{"begin":2,"length":1}]},{"pool":159,"snaps":[{"begin":3,"length":2}]},{"pool":161,"snaps":[{"begin":2,"length":1}]},{"pool":166,"snaps":[{"begin":4,"length":4}]},{"pool":168,"snaps":[{"begin":3,"length":3}]},{"pool":193,"snaps":[{"begin":7,"length":1}]},{"pool":199,"snaps":[{"begin":8,"length":1}]},{"pool":201,"snaps":[{"begin":10,"length":1}]},{"pool":214,"snaps":[{"begin":14,"length":1}]},{"pool":257,"snaps":[{"begin":2,"length":1}]},{"pool":258,"snaps":[{"begin":3,"length":1}]},{"pool":261,"snaps":[{"begin":4,"length":1}]},{"pool":265,"snaps":[{"begin":6,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-23T08:10:26.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.985+0000 7f270f467640 10 librados: watch_flush enter 2024-01-23T08:10:26.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.985+0000 7f270f467640 10 librados: watch_flush exit 2024-01-23T08:10:26.986 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.985+0000 7f270f467640 20 client.20920.objecter shutdown clearing up homeless session... 2024-01-23T08:10:26.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.985+0000 7f270f467640 10 client.20920.objecter successfully canceled tick 2024-01-23T08:10:26.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f26ec06c8b0 msgr2=0x7f26ec06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f26ec06c8b0 0x7f26ec06ed70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f2704009bd0 tx=0x7f2704009240 comp rx=0 tx=0).stop 2024-01-23T08:10:26.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 10 monclient: shutdown 2024-01-23T08:10:26.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:26.987 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27080a9ac0 msgr2=0x7f2708145860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27080a9ac0 0x7f2708145860 secure :-1 s=READY pgs=5215 cs=0 l=1 rev1=1 crypto rx=0x7f26f8033000 tx=0x7f26f80046c0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 shutdown_connections 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f26ec06c8b0 0x7f26ec06ed70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f27080b25b0 0x7f27081434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27080a9ac0 0x7f2708145860 unknown :-1 s=CLOSED pgs=5215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 --2- 172.21.15.116:0/398965350 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f27080a96e0 0x7f270813af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 >> 172.21.15.116:0/398965350 conn(0x7f27080b7bb0 msgr2=0x7f27080b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 shutdown_connections 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 -- 172.21.15.116:0/398965350 wait complete. 2024-01-23T08:10:26.988 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:26.986+0000 7f270f467640 1 librados: shutdown 2024-01-23T08:10:27.999 INFO:tasks.ceph:Scrubbing osd.0 2024-01-23T08:10:27.999 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:28.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.103+0000 7f6fdcbc9640 10 monclient: get_monmap_and_config 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.103+0000 7f6fdcbc9640 10 monclient: build_initial_monmap 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.103+0000 7f6fdcbc9640 10 monclient: monmap: 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:28.105143+0000 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:28.105143+0000 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:28.104 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:28.105 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:28.105 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.104+0000 7f6fdcbc9640 1 Processor -- start 2024-01-23T08:10:28.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.104+0000 7f6fdcbc9640 1 -- start start 2024-01-23T08:10:28.106 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.104+0000 7f6fdcbc9640 10 monclient: init 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient: _add_conns ranks=[2,0,1,4,3] 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80b2820 0x7f6fd813f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd80b2820 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6fd80a9c70 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f6fd80b1580 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80b2c00 con 0x7f6fd80a9c70 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80b33d0 con 0x7f6fd80b1580 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80b2eb0 con 0x7f6fd80b2820 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fdcbc9640 10 monclient(hunting): authenticate will time out at 4635.463686s 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fd5d9b640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f6fd80a9c70 0x7f6fd8142080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51730/0 (socket says 172.21.15.116:51730) 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.105+0000 7f6fd5d9b640 1 -- 172.21.15.116:0/632837652 learned_addr learned my addr 172.21.15.116:0/632837652 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:28.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.106+0000 7f6fd659c640 1 --2- 172.21.15.116:0/632837652 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80b2820 0x7f6fd813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.106+0000 7f6fd659c640 10 monclient(hunting): get_auth_request con 0x7f6fd80b2820 auth_method 0 2024-01-23T08:10:28.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.106+0000 7f6fd659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.106+0000 7f6fd659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.106+0000 7f6fd659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.106+0000 7f6fd659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.107+0000 7f6fd659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.108 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.107+0000 7f6fd659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd559a640 1 -- 172.21.15.116:0/632837652 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456736822 0 0) 0x7f6fd80b2c00 con 0x7f6fd80a9c70 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd559a640 10 monclient(hunting): _negotiate 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd559a640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd559a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd559a640 10 monclient(hunting): my global_id is 16521 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd559a640 1 -- 172.21.15.116:0/632837652 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc0003520 con 0x7f6fd80a9c70 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 10 monclient(hunting): handle_auth_done global_id 28430 payload 274 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 1 -- 172.21.15.116:0/632837652 >> v1:172.21.15.173:6789/0 conn(0x7f6fd80b1580 legacy=0x7f6fd814c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 1 -- 172.21.15.116:0/632837652 >> v1:172.21.15.116:6789/0 conn(0x7f6fd80a9c70 legacy=0x7f6fd8142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 10 monclient: _finish_hunting 0 2024-01-23T08:10:28.109 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 1 monclient: found mon.noname-b 2024-01-23T08:10:28.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:28.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:28.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.108+0000 7f6fd659c640 1 -- 172.21.15.116:0/632837652 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80b2020 con 0x7f6fd80b2820 2024-01-23T08:10:28.110 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.110+0000 7f6fd659c640 1 --2- 172.21.15.116:0/632837652 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80b2820 0x7f6fd813f320 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097d0 tx=0x7f6fc802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605b8412af0b4fee server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 1 -- 172.21.15.116:0/632837652 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8031800 con 0x7f6fd80b2820 2024-01-23T08:10:28.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.113 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: dump: 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: _finish_auth 0 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: _check_auth_tickets 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:28.114 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 1 -- 172.21.15.116:0/632837652 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8031960 con 0x7f6fd80b2820 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fdcbc9640 5 monclient: authenticate success, global_id 28430 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fdcbc9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fdcbc9640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 1 -- 172.21.15.116:0/632837652 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc8031cf0 con 0x7f6fd80b2820 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fdcbc9640 4 set_mon_vals no callback set 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.113+0000 7f6fd559a640 10 monclient: dump: 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.115 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.116 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.116 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.116 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.116 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 10 monclient: shutdown 2024-01-23T08:10:28.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:28.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/632837652 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80b2820 msgr2=0x7f6fd813f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 1 --2- 172.21.15.116:0/632837652 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80b2820 0x7f6fd813f320 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80097d0 tx=0x7f6fc802b8a0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/632837652 shutdown_connections 2024-01-23T08:10:28.119 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 1 --2- 172.21.15.116:0/632837652 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80b2820 0x7f6fd813f320 unknown :-1 s=CLOSED pgs=3324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/632837652 >> 172.21.15.116:0/632837652 conn(0x7f6fd806ccd0 msgr2=0x7f6fd8066450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/632837652 shutdown_connections 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.114+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/632837652 wait complete. 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 10 monclient: build_initial_monmap 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 10 monclient: monmap: 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:28.120 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:28.121 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 1 librados: starting msgr at 2024-01-23T08:10:28.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 1 librados: starting objecter 2024-01-23T08:10:28.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 1 Processor -- start 2024-01-23T08:10:28.121 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 1 -- start start 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 1 librados: setting wanted keys 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 1 librados: calling monclient init 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.115+0000 7f6fdcbc9640 10 monclient: init 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80a9c70 0x7f6fd813d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): picked mon.noname-c con 0x7f6fd80a9c70 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fd80b1580 0x7f6fd813e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): picked mon.noname-a con 0x7f6fd80b1580 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fd80b2820 0x7f6fd81d7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): picked mon.noname-b con 0x7f6fd80b2820 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8143d10 con 0x7f6fd80b1580 2024-01-23T08:10:28.122 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd8143f20 con 0x7f6fd80b2820 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81d7040 con 0x7f6fd80a9c70 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fdcbc9640 10 monclient(hunting): authenticate will time out at 4635.474703s 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fd659c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80a9c70 0x7f6fd813d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.116+0000 7f6fd5d9b640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fd80b1580 0x7f6fd813e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fd80b2820 0x7f6fd81d7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80a9c70 0x7f6fd813d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48410/0 (socket says 172.21.15.116:48410) 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 1 -- 172.21.15.116:0/865385196 learned_addr learned my addr 172.21.15.116:0/865385196 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 10 monclient(hunting): get_auth_request con 0x7f6fd80a9c70 auth_method 0 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.123 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd5d9b640 10 monclient(hunting): get_auth_request con 0x7f6fd80b1580 auth_method 0 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd5d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 10 monclient(hunting): get_auth_request con 0x7f6fd80b2820 auth_method 0 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.124 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.125 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.117+0000 7f6fd6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 10 monclient(hunting): handle_auth_done global_id 20926 payload 824 2024-01-23T08:10:28.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 1 -- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80a9c70 msgr2=0x7f6fd813d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f6fd80a9c70 0x7f6fd813d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 1 -- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fd80b1580 msgr2=0x7f6fd813e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6fd80b1580 0x7f6fd813e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 10 monclient: _finish_hunting 0 2024-01-23T08:10:28.126 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 1 monclient: found mon.noname-b 2024-01-23T08:10:28.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:28.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.120+0000 7f6fd6d9d640 1 -- 172.21.15.116:0/865385196 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc8009400 con 0x7f6fd80b2820 2024-01-23T08:10:28.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.123+0000 7f6fd6d9d640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fd80b2820 0x7f6fd81d7560 secure :-1 s=READY pgs=5217 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c690 tx=0x7f6fd000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.123+0000 7f6fc6ffd640 10 client.?.objecter ms_handle_connect 0x7f6fd80b2820 2024-01-23T08:10:28.127 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.123+0000 7f6fc6ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0003b70 con 0x7f6fd80b2820 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 10 monclient: dump: 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.129 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 10 monclient: _finish_auth 0 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fdcbc9640 5 monclient: authenticate success, global_id 20926 2024-01-23T08:10:28.130 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0003cd0 con 0x7f6fd80b2820 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fdcbc9640 10 monclient: _renew_subs 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fdcbc9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.126+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd813e740 con 0x7f6fd80b2820 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fc6ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0005310 con 0x7f6fd80b2820 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fc6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fc6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fc6ffd640 10 monclient: dump: 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.131 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.132 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fd4d99640 4 set_mon_vals no callback set 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 10 client.20926.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 10 monclient: _renew_subs 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd8134df0 con 0x7f6fd80b2820 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 1 librados: init done 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 10 client.20926.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 15 client.20926.objecter _session_command_op_assign -1 1 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 20 client.20926.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 10 client.20926.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.127+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fd8142a20 con 0x7f6fd80b2820 2024-01-23T08:10:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.147+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f6fd0005470 con 0x7f6fd80b2820 2024-01-23T08:10:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.147+0000 7f6fc6ffd640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6fb806c8b0 0x7f6fb806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.147+0000 7f6fd659c640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6fb806c8b0 0x7f6fb806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.147+0000 7f6fd659c640 10 monclient: get_auth_request con 0x7f6fb806c8b0 auth_method 0 2024-01-23T08:10:28.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.148+0000 7f6fc6ffd640 10 client.20926.objecter ms_handle_connect 0x7f6fb806c8b0 2024-01-23T08:10:28.148 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.148+0000 7f6fd659c640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6fb806c8b0 0x7f6fb806ed70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8000c00 tx=0x7f6fc803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f6fd0058880 con 0x7f6fd80b2820 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 10 client.20926.objecter ms_dispatch 0x7f6fd8000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 3 client.20926.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 3 client.20926.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 10 client.20926.objecter checking command 1 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7f6fb8074630 0x7f6fb8076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 20 client.20926.objecter _get_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.149+0000 7f6fc6ffd640 20 client.20926.objecter put_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 15 client.20926.objecter _session_command_op_remove -1 1 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 20 client.20926.objecter _get_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 20 client.20926.objecter get_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 15 client.20926.objecter _session_command_op_assign 0 1 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 20 client.20926.objecter put_session s=0x7f6fb8073f60 osd=0 4 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 10 client.20926.objecter _send_command 1 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 --> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fb80771a0 con 0x7f6fb8074630 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 20 client.20926.objecter dump_active .. 0 homeless 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fd0054bc0 con 0x7f6fd80b2820 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fc6ffd640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fd5d9b640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7f6fb8074630 0x7f6fb8076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.150+0000 7f6fd5d9b640 10 monclient: get_auth_request con 0x7f6fb8074630 auth_method 0 2024-01-23T08:10:28.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.153+0000 7f6fd5d9b640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7f6fb8074630 0x7f6fb8076ad0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.153+0000 7f6fc6ffd640 10 client.20926.objecter ms_handle_connect 0x7f6fb8074630 2024-01-23T08:10:28.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.176+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== osd.0 v2:172.21.15.116:6802/950064745 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6fb80771a0 con 0x7f6fb8074630 2024-01-23T08:10:28.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.176+0000 7f6fc6ffd640 10 client.20926.objecter ms_dispatch 0x7f6fd8000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:28.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.176+0000 7f6fc6ffd640 10 client.20926.objecter _finish_command 1 = system:0 2024-01-23T08:10:28.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.176+0000 7f6fc6ffd640 20 client.20926.objecter put_session s=0x7f6fb8073f60 osd=0 4 2024-01-23T08:10:28.177 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.176+0000 7f6fc6ffd640 15 client.20926.objecter _session_command_op_remove 0 1 2024-01-23T08:10:28.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 10 client.20926.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:28.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 15 client.20926.objecter _session_command_op_assign -1 2 2024-01-23T08:10:28.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 20 client.20926.objecter _get_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 20 client.20926.objecter put_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 20 client.20926.objecter _get_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 15 client.20926.objecter _session_command_op_remove -1 2 2024-01-23T08:10:28.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 20 client.20926.objecter get_session s=0x7f6fb8073f60 osd=0 3 2024-01-23T08:10:28.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 15 client.20926.objecter _session_command_op_assign 0 2 2024-01-23T08:10:28.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 20 client.20926.objecter put_session s=0x7f6fb8073f60 osd=0 4 2024-01-23T08:10:28.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 10 client.20926.objecter _send_command 2 2024-01-23T08:10:28.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.189+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 --> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6fd80aa120 con 0x7f6fb8074630 2024-01-23T08:10:28.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fc6ffd640 1 -- 172.21.15.116:0/865385196 <== osd.0 v2:172.21.15.116:6802/950064745 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6fd80aa120 con 0x7f6fb8074630 2024-01-23T08:10:28.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fc6ffd640 10 client.20926.objecter ms_dispatch 0x7f6fd8000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:28.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fc6ffd640 10 client.20926.objecter _finish_command 2 = system:0 2024-01-23T08:10:28.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fc6ffd640 20 client.20926.objecter put_session s=0x7f6fb8073f60 osd=0 4 2024-01-23T08:10:28.202 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fc6ffd640 15 client.20926.objecter _session_command_op_remove 0 2 2024-01-23T08:10:28.203 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:28.203 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:28.203 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:28.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 10 librados: watch_flush enter 2024-01-23T08:10:28.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 10 librados: watch_flush exit 2024-01-23T08:10:28.204 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 10 client.20926.objecter close_session for osd.0 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7f6fb8074630 msgr2=0x7f6fb8076ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6802/950064745,v1:172.21.15.116:6803/950064745] conn(0x7f6fb8074630 0x7f6fb8076ad0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 20 client.20926.objecter put_session s=0x7f6fb8073f60 osd=0 1 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 20 client.20926.objecter shutdown clearing up homeless session... 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 10 client.20926.objecter successfully canceled tick 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6fb806c8b0 msgr2=0x7f6fb806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f6fb806c8b0 0x7f6fb806ed70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8000c00 tx=0x7f6fc803c040 comp rx=0 tx=0).stop 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 10 monclient: shutdown 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fd80b2820 msgr2=0x7f6fd81d7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 --2- 172.21.15.116:0/865385196 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fd80b2820 0x7f6fd81d7560 secure :-1 s=READY pgs=5217 cs=0 l=1 rev1=1 crypto rx=0x7f6fd000c690 tx=0x7f6fd000cb50 comp rx=0 tx=0).stop 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fd6d9d640 1 -- 172.21.15.116:0/865385196 reap_dead start 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 shutdown_connections 2024-01-23T08:10:28.205 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 >> 172.21.15.116:0/865385196 conn(0x7f6fd806ccd0 msgr2=0x7f6fd8066450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:28.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 shutdown_connections 2024-01-23T08:10:28.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 -- 172.21.15.116:0/865385196 wait complete. 2024-01-23T08:10:28.206 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.202+0000 7f6fdcbc9640 1 librados: shutdown 2024-01-23T08:10:28.214 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-23T08:10:28.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.315+0000 7fb6a4749640 10 monclient: get_monmap_and_config 2024-01-23T08:10:28.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.315+0000 7fb6a4749640 10 monclient: build_initial_monmap 2024-01-23T08:10:28.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.315+0000 7fb6a4749640 10 monclient: monmap: 2024-01-23T08:10:28.337 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:28.316530+0000 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:28.316530+0000 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.315+0000 7fb6a4749640 1 Processor -- start 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.315+0000 7fb6a4749640 1 -- start start 2024-01-23T08:10:28.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.315+0000 7fb6a4749640 10 monclient: init 2024-01-23T08:10:28.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:28.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient: _add_conns ranks=[3,2,0,1,4] 2024-01-23T08:10:28.346 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb69c066450 0x7fb69c145970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient(hunting): picked mon.noname-a con 0x7fb69c066450 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c066830 0x7fb69c071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient(hunting): picked mon.noname-b con 0x7fb69c066830 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb69c06df60 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69c145fe0 con 0x7fb69c06df60 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69c146470 con 0x7fb69c066450 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c06f320 con 0x7fb69c066830 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.316+0000 7fb6a4749640 10 monclient(hunting): authenticate will time out at 4635.674890s 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.317+0000 7fb6a1ce4640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c066830 0x7fb69c071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.347 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.317+0000 7fb6a2ce6640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb69c06df60 0x7fb69c141f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51738/0 (socket says 172.21.15.116:51738) 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.317+0000 7fb6a2ce6640 1 -- 172.21.15.116:0/2061014525 learned_addr learned my addr 172.21.15.116:0/2061014525 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.317+0000 7fb6a1ce4640 10 monclient(hunting): get_auth_request con 0x7fb69c066830 auth_method 0 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.317+0000 7fb6a1ce4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.317+0000 7fb6a1ce4640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.317+0000 7fb6a1ce4640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.318+0000 7fb6a24e5640 1 --2- 172.21.15.116:0/2061014525 >> v2:172.21.15.116:3300/0 conn(0x7fb69c066450 0x7fb69c145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.318+0000 7fb6a1ce4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.318+0000 7fb6a1ce4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.318+0000 7fb6a1ce4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 10 monclient(hunting): handle_auth_done global_id 28436 payload 274 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 1 -- 172.21.15.116:0/2061014525 >> v2:172.21.15.116:3300/0 conn(0x7fb69c066450 msgr2=0x7fb69c145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 1 --2- 172.21.15.116:0/2061014525 >> v2:172.21.15.116:3300/0 conn(0x7fb69c066450 0x7fb69c145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 1 -- 172.21.15.116:0/2061014525 >> v1:172.21.15.116:6789/0 conn(0x7fb69c06df60 legacy=0x7fb69c141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 10 monclient: _finish_hunting 0 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 1 monclient: found mon.noname-b 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.319+0000 7fb6a1ce4640 1 -- 172.21.15.116:0/2061014525 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0723f0 con 0x7fb69c066830 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.321+0000 7fb6a1ce4640 1 --2- 172.21.15.116:0/2061014525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c066830 0x7fb69c071eb0 secure :-1 s=READY pgs=3325 cs=0 l=1 rev1=1 crypto rx=0x7fb6980097a0 tx=0x7fb69802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf695be43e822e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 1 -- 172.21.15.116:0/2061014525 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698031830 con 0x7fb69c066830 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: dump: 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.349 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: _finish_auth 0 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: _check_auth_tickets 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 1 -- 172.21.15.116:0/2061014525 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698031990 con 0x7fb69c066830 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a4749640 5 monclient: authenticate success, global_id 28436 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a4749640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a4749640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:28.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a4749640 4 set_mon_vals no callback set 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 1 -- 172.21.15.116:0/2061014525 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698031d20 con 0x7fb69c066830 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.325+0000 7fb6a14e3640 10 monclient: dump: 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.351 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 10 monclient: shutdown 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 -- 172.21.15.116:0/2061014525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c066830 msgr2=0x7fb69c071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 --2- 172.21.15.116:0/2061014525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c066830 0x7fb69c071eb0 secure :-1 s=READY pgs=3325 cs=0 l=1 rev1=1 crypto rx=0x7fb6980097a0 tx=0x7fb69802b8d0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 -- 172.21.15.116:0/2061014525 shutdown_connections 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 --2- 172.21.15.116:0/2061014525 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c066830 0x7fb69c071eb0 unknown :-1 s=CLOSED pgs=3325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 --2- 172.21.15.116:0/2061014525 >> v2:172.21.15.116:3300/0 conn(0x7fb69c066450 0x7fb69c145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 -- 172.21.15.116:0/2061014525 >> 172.21.15.116:0/2061014525 conn(0x7fb69c0b4460 msgr2=0x7fb69c0b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 -- 172.21.15.116:0/2061014525 shutdown_connections 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 1 -- 172.21.15.116:0/2061014525 wait complete. 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 10 monclient: build_initial_monmap 2024-01-23T08:10:28.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.326+0000 7fb6a4749640 10 monclient: monmap: 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 librados: starting msgr at 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 librados: starting objecter 2024-01-23T08:10:28.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 Processor -- start 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 -- start start 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 librados: setting wanted keys 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 librados: calling monclient init 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient: init 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb69c066450 0x7fb69c1356a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient(hunting): picked mon.noname-b con 0x7fb69c066450 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb69c06df60 0x7fb69c1448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient(hunting): picked mon.noname-a con 0x7fb69c06df60 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c144df0 0x7fb69c133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient(hunting): picked mon.noname-c con 0x7fb69c144df0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:28.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c133a80 con 0x7fb69c06df60 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c1d4c50 con 0x7fb69c066450 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.327+0000 7fb6a4749640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a4749640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69c144180 con 0x7fb69c144df0 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a4749640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a4749640 10 monclient(hunting): authenticate will time out at 4635.686205s 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a2ce6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c144df0 0x7fb69c133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a24e5640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb69c066450 0x7fb69c1356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a1ce4640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb69c06df60 0x7fb69c1448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a2ce6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c144df0 0x7fb69c133ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48428/0 (socket says 172.21.15.116:48428) 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a2ce6640 1 -- 172.21.15.116:0/1189707567 learned_addr learned my addr 172.21.15.116:0/1189707567 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.328+0000 7fb6a2ce6640 10 monclient(hunting): get_auth_request con 0x7fb69c144df0 auth_method 0 2024-01-23T08:10:28.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a2ce6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a2ce6640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a2ce6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a1ce4640 10 monclient(hunting): get_auth_request con 0x7fb69c06df60 auth_method 0 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a1ce4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a1ce4640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a1ce4640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a24e5640 10 monclient(hunting): get_auth_request con 0x7fb69c066450 auth_method 0 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a24e5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a24e5640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a24e5640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a2ce6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a2ce6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a2ce6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a24e5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a24e5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a24e5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a1ce4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a1ce4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.329+0000 7fb6a1ce4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 10 monclient(hunting): handle_auth_done global_id 20929 payload 824 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 1 -- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c144df0 msgr2=0x7fb69c133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c144df0 0x7fb69c133ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 1 -- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb69c06df60 msgr2=0x7fb69c1448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb69c06df60 0x7fb69c1448b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 10 monclient: _finish_hunting 0 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 1 monclient: found mon.noname-b 2024-01-23T08:10:28.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.332+0000 7fb6a24e5640 1 -- 172.21.15.116:0/1189707567 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb698009400 con 0x7fb69c066450 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.334+0000 7fb6a24e5640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb69c066450 0x7fb69c1356a0 secure :-1 s=READY pgs=5218 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c5e0 tx=0x7fb68c00caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.334+0000 7fb692ffd640 10 client.?.objecter ms_handle_connect 0x7fb69c066450 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.334+0000 7fb692ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 1 -- 172.21.15.116:0/1189707567 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c004220 con 0x7fb69c066450 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: dump: 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.358 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: _finish_auth 0 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 1 -- 172.21.15.116:0/1189707567 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c004380 con 0x7fb69c066450 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 5 monclient: authenticate success, global_id 20929 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 10 monclient: _renew_subs 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.359 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69c1da540 con 0x7fb69c066450 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 1 -- 172.21.15.116:0/1189707567 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c003850 con 0x7fb69c066450 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb692ffd640 10 monclient: dump: 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.360 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 10 client.20929.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 10 monclient: _renew_subs 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69c1345f0 con 0x7fb69c066450 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a0ce2640 4 set_mon_vals no callback set 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.338+0000 7fb6a4749640 1 librados: init done 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.339+0000 7fb6a4749640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.339+0000 7fb6a4749640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.339+0000 7fb6a4749640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:28.361 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.339+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69c1445f0 con 0x7fb69c066450 2024-01-23T08:10:28.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.578+0000 7fb692ffd640 1 -- 172.21.15.116:0/1189707567 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb68c0039b0 con 0x7fb69c066450 2024-01-23T08:10:28.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.579+0000 7fb692ffd640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb68006c890 0x7fb68006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.579+0000 7fb6a1ce4640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb68006c890 0x7fb68006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.579+0000 7fb6a1ce4640 10 monclient: get_auth_request con 0x7fb68006c890 auth_method 0 2024-01-23T08:10:28.579 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.579+0000 7fb6a1ce4640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb68006c890 0x7fb68006ed50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb698036000 tx=0x7fb69803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.580 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.579+0000 7fb692ffd640 10 client.20929.objecter ms_handle_connect 0x7fb68006c890 2024-01-23T08:10:28.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.581+0000 7fb692ffd640 1 -- 172.21.15.116:0/1189707567 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fb68c058180 con 0x7fb69c066450 2024-01-23T08:10:28.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.581+0000 7fb692ffd640 10 client.20929.objecter ms_dispatch 0x7fb69c000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:28.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.581+0000 7fb692ffd640 3 client.20929.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:28.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.581+0000 7fb692ffd640 3 client.20929.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:28.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.581+0000 7fb692ffd640 20 client.20929.objecter dump_active .. 0 homeless 2024-01-23T08:10:28.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.591+0000 7fb692ffd640 1 -- 172.21.15.116:0/1189707567 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fb68c0544c0 con 0x7fb69c066450 2024-01-23T08:10:28.590 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.591+0000 7fb692ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:28.591 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.591+0000 7fb692ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:28.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.778+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb69c14c820 con 0x7fb68006c890 2024-01-23T08:10:28.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.778+0000 7fb692ffd640 1 -- 172.21.15.116:0/1189707567 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb69803a420 con 0x7fb68006c890 2024-01-23T08:10:28.778 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 0 to deep-scrub 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 10 librados: watch_flush enter 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 10 librados: watch_flush exit 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 20 client.20929.objecter shutdown clearing up homeless session... 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 10 client.20929.objecter successfully canceled tick 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb68006c890 msgr2=0x7fb68006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb68006c890 0x7fb68006ed50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb698036000 tx=0x7fb69803c040 comp rx=0 tx=0).stop 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 10 monclient: shutdown 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:28.782 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb69c066450 msgr2=0x7fb69c1356a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb69c066450 0x7fb69c1356a0 secure :-1 s=READY pgs=5218 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c5e0 tx=0x7fb68c00caa0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 shutdown_connections 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb68006c890 0x7fb68006ed50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb69c144df0 0x7fb69c133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb69c06df60 0x7fb69c1448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 --2- 172.21.15.116:0/1189707567 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb69c066450 0x7fb69c1356a0 unknown :-1 s=CLOSED pgs=5218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 >> 172.21.15.116:0/1189707567 conn(0x7fb69c0b4460 msgr2=0x7fb69c0adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 shutdown_connections 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 -- 172.21.15.116:0/1189707567 wait complete. 2024-01-23T08:10:28.783 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.781+0000 7fb6a4749640 1 librados: shutdown 2024-01-23T08:10:28.792 INFO:tasks.ceph:Scrubbing osd.1 2024-01-23T08:10:28.792 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:28.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.898+0000 7fbfeaaa3640 10 monclient: get_monmap_and_config 2024-01-23T08:10:28.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.898+0000 7fbfeaaa3640 10 monclient: build_initial_monmap 2024-01-23T08:10:28.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.898+0000 7fbfeaaa3640 10 monclient: monmap: 2024-01-23T08:10:28.898 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:28.899717+0000 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:28.899717+0000 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:28.899 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 1 Processor -- start 2024-01-23T08:10:28.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 1 -- start start 2024-01-23T08:10:28.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 10 monclient: init 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 10 monclient: _add_conns ranks=[2,4,3,0,1] 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe413f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 10 monclient(hunting): picked mon.noname-b con 0x7fbfe40b2820 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fbfe40a9c70 0x7fbfe413f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 10 monclient(hunting): picked mon.noname-c con 0x7fbfe40a9c70 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fbfe40b1580 0x7fbfe4142080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 10 monclient(hunting): picked mon.noname-a con 0x7fbfe40b1580 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.899+0000 7fbfeaaa3640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe40b5300 con 0x7fbfe40b1580 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.900+0000 7fbfeaaa3640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.900+0000 7fbfeaaa3640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfe40b2c00 con 0x7fbfe40a9c70 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.900+0000 7fbfeaaa3640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.902 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.900+0000 7fbfeaaa3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe40b33d0 con 0x7fbfe40b2820 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.900+0000 7fbfeaaa3640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.900+0000 7fbfeaaa3640 10 monclient(hunting): authenticate will time out at 4636.258215s 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.900+0000 7fbfe883f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe413f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe413f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48438/0 (socket says 172.21.15.116:48438) 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 1 -- 172.21.15.116:0/3542272319 learned_addr learned my addr 172.21.15.116:0/3542272319 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 10 monclient(hunting): get_auth_request con 0x7fbfe40b2820 auth_method 0 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe883f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.903 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.901+0000 7fbfe3fff640 1 --2- 172.21.15.116:0/3542272319 >> v2:172.21.15.173:3300/0 conn(0x7fbfe40a9c70 0x7fbfe413f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe9040640 1 --2- 172.21.15.116:0/3542272319 >> v2:172.21.15.116:3300/0 conn(0x7fbfe40b1580 0x7fbfe4142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe3fff640 10 monclient(hunting): get_auth_request con 0x7fbfe40a9c70 auth_method 0 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe3fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe3fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe9040640 10 monclient(hunting): get_auth_request con 0x7fbfe40b1580 auth_method 0 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe9040640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe9040640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.902+0000 7fbfe9040640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 10 monclient(hunting): handle_auth_done global_id 28442 payload 274 2024-01-23T08:10:28.905 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 1 -- 172.21.15.116:0/3542272319 >> v2:172.21.15.173:3300/0 conn(0x7fbfe40a9c70 msgr2=0x7fbfe413f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 1 --2- 172.21.15.116:0/3542272319 >> v2:172.21.15.173:3300/0 conn(0x7fbfe40a9c70 0x7fbfe413f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 1 -- 172.21.15.116:0/3542272319 >> v2:172.21.15.116:3300/0 conn(0x7fbfe40b1580 msgr2=0x7fbfe4142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 1 --2- 172.21.15.116:0/3542272319 >> v2:172.21.15.116:3300/0 conn(0x7fbfe40b1580 0x7fbfe4142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 10 monclient: _finish_hunting 0 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 1 monclient: found mon.noname-b 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:28.906 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.903+0000 7fbfe883f640 1 -- 172.21.15.116:0/3542272319 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe40b2eb0 con 0x7fbfe40b2820 2024-01-23T08:10:28.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.910+0000 7fbfe883f640 1 --2- 172.21.15.116:0/3542272319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe413f320 secure :-1 s=READY pgs=3326 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4067150 tx=0x7fbfd802b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a94a0ed054ff72f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 1 -- 172.21.15.116:0/3542272319 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80317e0 con 0x7fbfe40b2820 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: dump: 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.961 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: _finish_auth 0 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: _check_auth_tickets 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 1 -- 172.21.15.116:0/3542272319 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8031940 con 0x7fbfe40b2820 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 5 monclient: authenticate success, global_id 28442 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:28.962 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 1 -- 172.21.15.116:0/3542272319 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8031cd0 con 0x7fbfe40b2820 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 4 set_mon_vals no callback set 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfe37fe640 10 monclient: dump: 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.963 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 10 monclient: shutdown 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/3542272319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 msgr2=0x7fbfe413f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.960+0000 7fbfeaaa3640 1 --2- 172.21.15.116:0/3542272319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe413f320 secure :-1 s=READY pgs=3326 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4067150 tx=0x7fbfd802b880 comp rx=0 tx=0).stop 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/3542272319 shutdown_connections 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 --2- 172.21.15.116:0/3542272319 >> v2:172.21.15.116:3300/0 conn(0x7fbfe40b1580 0x7fbfe4142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 --2- 172.21.15.116:0/3542272319 >> v2:172.21.15.173:3300/0 conn(0x7fbfe40a9c70 0x7fbfe413f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 --2- 172.21.15.116:0/3542272319 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe413f320 unknown :-1 s=CLOSED pgs=3326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/3542272319 >> 172.21.15.116:0/3542272319 conn(0x7fbfe406ccd0 msgr2=0x7fbfe4066450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/3542272319 shutdown_connections 2024-01-23T08:10:28.964 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/3542272319 wait complete. 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 10 monclient: build_initial_monmap 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 10 monclient: monmap: 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:28.968 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 librados: starting msgr at 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.961+0000 7fbfeaaa3640 1 librados: starting objecter 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 Processor -- start 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 -- start start 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 librados: setting wanted keys 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 librados: calling monclient init 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient: init 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe40a9c70 0x7fbfe4141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): picked mon.noname-a con 0x7fbfe40a9c70 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfe40b1580 0x7fbfe4140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): picked mon.noname-b con 0x7fbfe40b1580 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe4144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): picked mon.noname-c con 0x7fbfe40b2820 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4141f40 con 0x7fbfe40a9c70 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4144350 con 0x7fbfe40b1580 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4141400 con 0x7fbfe40b2820 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.962+0000 7fbfeaaa3640 10 monclient(hunting): authenticate will time out at 4636.321023s 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe883f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe40a9c70 0x7fbfe4141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe9040640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe4144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe883f640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe40a9c70 0x7fbfe4141820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33800/0 (socket says 172.21.15.116:33800) 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe883f640 1 -- 172.21.15.116:0/1360917420 learned_addr learned my addr 172.21.15.116:0/1360917420 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:28.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe883f640 10 monclient(hunting): get_auth_request con 0x7fbfe40a9c70 auth_method 0 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe883f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe883f640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe883f640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe3fff640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfe40b1580 0x7fbfe4140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe9040640 10 monclient(hunting): get_auth_request con 0x7fbfe40b2820 auth_method 0 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe9040640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe9040640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe9040640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe3fff640 10 monclient(hunting): get_auth_request con 0x7fbfe40b1580 auth_method 0 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe3fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.963+0000 7fbfe3fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe883f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe883f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe883f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe9040640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe9040640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe9040640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.964+0000 7fbfe3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 10 monclient(hunting): handle_auth_done global_id 16536 payload 824 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 1 -- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 msgr2=0x7fbfe4144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fbfe40b2820 0x7fbfe4144770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 1 -- 172.21.15.116:0/1360917420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfe40b1580 msgr2=0x7fbfe4140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfe40b1580 0x7fbfe4140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 10 monclient: _finish_hunting 0 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 1 monclient: found mon.noname-a 2024-01-23T08:10:28.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:28.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:28.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe883f640 1 -- 172.21.15.116:0/1360917420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80094d0 con 0x7fbfe40a9c70 2024-01-23T08:10:28.973 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.967+0000 7fbfe3fff640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbfe40b1580 0x7fbfe4140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:10:28.974 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.969+0000 7fbfe883f640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe40a9c70 0x7fbfe4141820 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7fbfd802b8c0 tx=0x7fbfd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.969+0000 7fbfe17fa640 10 client.?.objecter ms_handle_connect 0x7fbfe40a9c70 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.969+0000 7fbfe17fa640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8032880 con 0x7fbfe40a9c70 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: dump: 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.975 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: _finish_auth 0 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: _check_auth_tickets 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8032a00 con 0x7fbfe40a9c70 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 5 monclient: authenticate success, global_id 16536 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 monclient: _renew_subs 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe4144cb0 con 0x7fbfe40a9c70 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8032db0 con 0x7fbfe40a9c70 2024-01-23T08:10:28.976 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe17fa640 10 monclient: dump: 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfe2ffd640 4 set_mon_vals no callback set 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 client.16536.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:28.977 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 monclient: _renew_subs 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe4145180 con 0x7fbfe40a9c70 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 1 librados: init done 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 client.16536.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 15 client.16536.objecter _session_command_op_assign -1 1 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 20 client.16536.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 client.16536.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:28.978 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.973+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbfe41441c0 con 0x7fbfe40a9c70 2024-01-23T08:10:28.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.992+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fbfd804d3f0 con 0x7fbfe40a9c70 2024-01-23T08:10:28.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.993+0000 7fbfe17fa640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbfc806c860 0x7fbfc806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.993+0000 7fbfe3fff640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbfc806c860 0x7fbfc806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.993+0000 7fbfe3fff640 10 monclient: get_auth_request con 0x7fbfc806c860 auth_method 0 2024-01-23T08:10:28.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.993+0000 7fbfe3fff640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbfc806c860 0x7fbfc806ed20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40b3d90 tx=0x7fbfd0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:28.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.993+0000 7fbfe17fa640 10 client.16536.objecter ms_handle_connect 0x7fbfc806c860 2024-01-23T08:10:28.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.996+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fbfd807a290 con 0x7fbfe40a9c70 2024-01-23T08:10:28.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.996+0000 7fbfe17fa640 10 client.16536.objecter ms_dispatch 0x7fbfe4000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:28.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.996+0000 7fbfe17fa640 3 client.16536.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:28.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.996+0000 7fbfe17fa640 3 client.16536.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:28.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 10 client.16536.objecter checking command 1 2024-01-23T08:10:28.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fbfc80745e0 0x7fbfc8076a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:28.997 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 20 client.16536.objecter _get_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 20 client.16536.objecter put_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 15 client.16536.objecter _session_command_op_remove -1 1 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 20 client.16536.objecter _get_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 20 client.16536.objecter get_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 15 client.16536.objecter _session_command_op_assign 1 1 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 20 client.16536.objecter put_session s=0x7fbfc8073f10 osd=1 4 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 10 client.16536.objecter _send_command 1 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 --> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbfc8077150 con 0x7fbfc80745e0 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 20 client.16536.objecter dump_active .. 0 homeless 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfd80765d0 con 0x7fbfe40a9c70 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe17fa640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:28.998 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.997+0000 7fbfe9040640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fbfc80745e0 0x7fbfc8076a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:28.999 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:28.998+0000 7fbfe9040640 10 monclient: get_auth_request con 0x7fbfc80745e0 auth_method 0 2024-01-23T08:10:29.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.000+0000 7fbfe9040640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fbfc80745e0 0x7fbfc8076a80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.000 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.000+0000 7fbfe17fa640 10 client.16536.objecter ms_handle_connect 0x7fbfc80745e0 2024-01-23T08:10:29.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.024+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== osd.1 v2:172.21.15.116:6810/745967066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fbfc8077150 con 0x7fbfc80745e0 2024-01-23T08:10:29.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.024+0000 7fbfe17fa640 10 client.16536.objecter ms_dispatch 0x7fbfe4000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:29.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.024+0000 7fbfe17fa640 10 client.16536.objecter _finish_command 1 = system:0 2024-01-23T08:10:29.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.024+0000 7fbfe17fa640 20 client.16536.objecter put_session s=0x7fbfc8073f10 osd=1 4 2024-01-23T08:10:29.024 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.024+0000 7fbfe17fa640 15 client.16536.objecter _session_command_op_remove 1 1 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 10 client.16536.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 15 client.16536.objecter _session_command_op_assign -1 2 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 20 client.16536.objecter _get_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 20 client.16536.objecter put_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 20 client.16536.objecter _get_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 15 client.16536.objecter _session_command_op_remove -1 2 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 20 client.16536.objecter get_session s=0x7fbfc8073f10 osd=1 3 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 15 client.16536.objecter _session_command_op_assign 1 2 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 20 client.16536.objecter put_session s=0x7fbfc8073f10 osd=1 4 2024-01-23T08:10:29.037 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 10 client.16536.objecter _send_command 2 2024-01-23T08:10:29.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.037+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 --> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbfe4142080 con 0x7fbfc80745e0 2024-01-23T08:10:29.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfe17fa640 1 -- 172.21.15.116:0/1360917420 <== osd.1 v2:172.21.15.116:6810/745967066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbfdc0083a0 con 0x7fbfc80745e0 2024-01-23T08:10:29.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfe17fa640 10 client.16536.objecter ms_dispatch 0x7fbfe4000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:29.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfe17fa640 10 client.16536.objecter _finish_command 2 = system:0 2024-01-23T08:10:29.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfe17fa640 20 client.16536.objecter put_session s=0x7fbfc8073f10 osd=1 4 2024-01-23T08:10:29.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfe17fa640 15 client.16536.objecter _session_command_op_remove 1 2 2024-01-23T08:10:29.053 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:29.053 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:29.053 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:29.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 10 librados: watch_flush enter 2024-01-23T08:10:29.054 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 10 librados: watch_flush exit 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 10 client.16536.objecter close_session for osd.1 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fbfc80745e0 msgr2=0x7fbfc8076a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6810/745967066,v1:172.21.15.116:6811/745967066] conn(0x7fbfc80745e0 0x7fbfc8076a80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 20 client.16536.objecter put_session s=0x7fbfc8073f10 osd=1 1 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 20 client.16536.objecter shutdown clearing up homeless session... 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.052+0000 7fbfeaaa3640 10 client.16536.objecter successfully canceled tick 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbfc806c860 msgr2=0x7fbfc806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fbfc806c860 0x7fbfc806ed20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fbfe40b3d90 tx=0x7fbfd0008040 comp rx=0 tx=0).stop 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 10 monclient: shutdown 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe40a9c70 msgr2=0x7fbfe4141820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 --2- 172.21.15.116:0/1360917420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfe40a9c70 0x7fbfe4141820 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7fbfd802b8c0 tx=0x7fbfd80046c0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfe9040640 1 -- 172.21.15.116:0/1360917420 reap_dead start 2024-01-23T08:10:29.055 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 shutdown_connections 2024-01-23T08:10:29.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 >> 172.21.15.116:0/1360917420 conn(0x7fbfe406ccd0 msgr2=0x7fbfe40b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:29.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 shutdown_connections 2024-01-23T08:10:29.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 -- 172.21.15.116:0/1360917420 wait complete. 2024-01-23T08:10:29.056 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.053+0000 7fbfeaaa3640 1 librados: shutdown 2024-01-23T08:10:29.063 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-23T08:10:29.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.164+0000 7fcbceb8d640 10 monclient: get_monmap_and_config 2024-01-23T08:10:29.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.164+0000 7fcbceb8d640 10 monclient: build_initial_monmap 2024-01-23T08:10:29.164 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.164+0000 7fcbceb8d640 10 monclient: monmap: 2024-01-23T08:10:29.164 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:29.164 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.164 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:29.165475+0000 2024-01-23T08:10:29.164 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:29.165475+0000 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:29.165 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 1 Processor -- start 2024-01-23T08:10:29.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 1 -- start start 2024-01-23T08:10:29.167 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient: init 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient: _add_conns ranks=[4,0,2,1,3] 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fcbc80a96e0 0x7fcbc80b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient(hunting): picked mon.noname-c con 0x7fcbc80a96e0 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcbc813f390 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc8145600 0x7fcbc8145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient(hunting): picked mon.noname-b con 0x7fcbc8145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80aac10 con 0x7fcbc813f390 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc80a9e00 con 0x7fcbc80a96e0 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80a9ac0 con 0x7fcbc8145600 2024-01-23T08:10:29.168 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.165+0000 7fcbceb8d640 10 monclient(hunting): authenticate will time out at 4636.524068s 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbc7fff640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fcbc813f390 0x7fcbc813f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51750/0 (socket says 172.21.15.116:51750) 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbc7fff640 1 -- 172.21.15.116:0/3438462210 learned_addr learned my addr 172.21.15.116:0/3438462210 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcd12a640 1 --2- 172.21.15.116:0/3438462210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc8145600 0x7fcbc8145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcc929640 1 --2- 172.21.15.116:0/3438462210 >> v2:172.21.15.173:3300/0 conn(0x7fcbc80a96e0 0x7fcbc80b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcc929640 10 monclient(hunting): get_auth_request con 0x7fcbc80a96e0 auth_method 0 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcc929640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcc929640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcc929640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcd12a640 10 monclient(hunting): get_auth_request con 0x7fcbc8145600 auth_method 0 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcd12a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcd12a640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.166+0000 7fcbcd12a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.169 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.167+0000 7fcbcc929640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.167+0000 7fcbcc929640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.167+0000 7fcbcc929640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.167+0000 7fcbcd12a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.167+0000 7fcbcd12a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.167+0000 7fcbcd12a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbc77fe640 1 -- 172.21.15.116:0/3438462210 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958083840 0 0) 0x7fcbc80aac10 con 0x7fcbc813f390 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbc77fe640 10 monclient(hunting): _negotiate 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbc77fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbc77fe640 10 monclient(hunting): my global_id is 16539 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbc77fe640 1 -- 172.21.15.116:0/3438462210 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbb8003520 con 0x7fcbc813f390 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 10 monclient(hunting): handle_auth_done global_id 20938 payload 274 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 1 -- 172.21.15.116:0/3438462210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc8145600 msgr2=0x7fcbc8145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:29.171 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 1 --2- 172.21.15.116:0/3438462210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc8145600 0x7fcbc8145a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 1 -- 172.21.15.116:0/3438462210 >> v1:172.21.15.116:6789/0 conn(0x7fcbc813f390 legacy=0x7fcbc813f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 10 monclient: _finish_hunting 0 2024-01-23T08:10:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 1 monclient: found mon.noname-c 2024-01-23T08:10:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T08:10:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.168+0000 7fcbcc929640 1 -- 172.21.15.116:0/3438462210 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80aae80 con 0x7fcbc80a96e0 2024-01-23T08:10:29.172 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.170+0000 7fcbcc929640 1 --2- 172.21.15.116:0/3438462210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc80b1850 secure :-1 s=READY pgs=5219 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097a0 tx=0x7fcbbc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d331ab837739971 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 1 -- 172.21.15.116:0/3438462210 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc031830 con 0x7fcbc80a96e0 2024-01-23T08:10:29.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: dump: 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: _finish_auth 0 2024-01-23T08:10:29.175 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: _check_auth_tickets 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 1 -- 172.21.15.116:0/3438462210 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc031990 con 0x7fcbc80a96e0 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbceb8d640 5 monclient: authenticate success, global_id 20938 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbceb8d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbceb8d640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbceb8d640 4 set_mon_vals no callback set 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 1 -- 172.21.15.116:0/3438462210 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc031d20 con 0x7fcbc80a96e0 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.174+0000 7fcbc77fe640 10 monclient: dump: 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.176 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.177 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.177 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.177 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.177 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.177 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.177 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.177 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 10 monclient: shutdown 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 -- 172.21.15.116:0/3438462210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 msgr2=0x7fcbc80b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/3438462210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc80b1850 secure :-1 s=READY pgs=5219 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc0097a0 tx=0x7fcbbc02b8d0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 -- 172.21.15.116:0/3438462210 shutdown_connections 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/3438462210 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc8145600 0x7fcbc8145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/3438462210 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc80b1850 unknown :-1 s=CLOSED pgs=5219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 -- 172.21.15.116:0/3438462210 >> 172.21.15.116:0/3438462210 conn(0x7fcbc80b7bb0 msgr2=0x7fcbc80b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 -- 172.21.15.116:0/3438462210 shutdown_connections 2024-01-23T08:10:29.181 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.175+0000 7fcbceb8d640 1 -- 172.21.15.116:0/3438462210 wait complete. 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 10 monclient: build_initial_monmap 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 10 monclient: monmap: 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 1 librados: starting msgr at 2024-01-23T08:10:29.182 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 1 librados: starting objecter 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 1 Processor -- start 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 1 -- start start 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 1 librados: setting wanted keys 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 1 librados: calling monclient init 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.176+0000 7fcbceb8d640 10 monclient: init 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc8144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): picked mon.noname-b con 0x7fcbc80a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc813f390 0x7fcbc8138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): picked mon.noname-c con 0x7fcbc813f390 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc8145600 0x7fcbc81360e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): picked mon.noname-a con 0x7fcbc8145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.183 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8137c30 con 0x7fcbc8145600 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8138c20 con 0x7fcbc80a96e0 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81388c0 con 0x7fcbc813f390 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbceb8d640 10 monclient(hunting): authenticate will time out at 4636.535421s 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbcd12a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc8145600 0x7fcbc81360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbcc929640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc8144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.177+0000 7fcbc7fff640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc813f390 0x7fcbc8138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc8145600 0x7fcbc81360e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33814/0 (socket says 172.21.15.116:33814) 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 1 -- 172.21.15.116:0/2190593771 learned_addr learned my addr 172.21.15.116:0/2190593771 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 10 monclient(hunting): get_auth_request con 0x7fcbc8145600 auth_method 0 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.184 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcc929640 10 monclient(hunting): get_auth_request con 0x7fcbc80a96e0 auth_method 0 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcc929640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcc929640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcc929640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbc7fff640 10 monclient(hunting): get_auth_request con 0x7fcbc813f390 auth_method 0 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbc7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbc7fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbc7fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcc929640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcc929640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcc929640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.185 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbcd12a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbc7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbc7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.178+0000 7fcbc7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 10 monclient(hunting): handle_auth_done global_id 20941 payload 824 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 1 -- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc813f390 msgr2=0x7fcbc8138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc813f390 0x7fcbc8138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 1 -- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc8145600 msgr2=0x7fcbc81360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc8145600 0x7fcbc81360e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 10 monclient: _finish_hunting 0 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 1 monclient: found mon.noname-b 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:29.186 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.181+0000 7fcbcc929640 1 -- 172.21.15.116:0/2190593771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc009400 con 0x7fcbc80a96e0 2024-01-23T08:10:29.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.183+0000 7fcbcc929640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc8144be0 secure :-1 s=READY pgs=5220 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc033000 tx=0x7fcbbc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.183+0000 7fcbc57fa640 10 client.?.objecter ms_handle_connect 0x7fcbc80a96e0 2024-01-23T08:10:29.188 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.183+0000 7fcbc57fa640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 1 -- 172.21.15.116:0/2190593771 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc03a630 con 0x7fcbc80a96e0 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: dump: 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.189 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: _finish_auth 0 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: _check_auth_tickets 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 1 -- 172.21.15.116:0/2190593771 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc03a7b0 con 0x7fcbc80a96e0 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 1 -- 172.21.15.116:0/2190593771 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc03ab60 con 0x7fcbc80a96e0 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbceb8d640 5 monclient: authenticate success, global_id 20941 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbceb8d640 10 monclient: _renew_subs 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbceb8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:29.190 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc80b77f0 con 0x7fcbc80a96e0 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc6ffd640 4 set_mon_vals no callback set 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.186+0000 7fcbc57fa640 10 monclient: dump: 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.191 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 10 client.20941.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 10 monclient: _renew_subs 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc8136800 con 0x7fcbc80a96e0 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 1 librados: init done 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:29.192 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.187+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc8067d70 con 0x7fcbc80a96e0 2024-01-23T08:10:29.426 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.426+0000 7fcbc57fa640 1 -- 172.21.15.116:0/2190593771 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fcbbc03acc0 con 0x7fcbc80a96e0 2024-01-23T08:10:29.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.427+0000 7fcbc57fa640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcbac06c860 0x7fcbac06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.427+0000 7fcbc7fff640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcbac06c860 0x7fcbac06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.427+0000 7fcbc7fff640 10 monclient: get_auth_request con 0x7fcbac06c860 auth_method 0 2024-01-23T08:10:29.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.427+0000 7fcbc57fa640 10 client.20941.objecter ms_handle_connect 0x7fcbac06c860 2024-01-23T08:10:29.427 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.427+0000 7fcbc7fff640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcbac06c860 0x7fcbac06ed20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8145240 tx=0x7fcbb4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.429+0000 7fcbc57fa640 1 -- 172.21.15.116:0/2190593771 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fcbbc07a230 con 0x7fcbc80a96e0 2024-01-23T08:10:29.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.429+0000 7fcbc57fa640 10 client.20941.objecter ms_dispatch 0x7fcbc8000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:29.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.429+0000 7fcbc57fa640 3 client.20941.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:29.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.429+0000 7fcbc57fa640 3 client.20941.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:29.429 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.429+0000 7fcbc57fa640 20 client.20941.objecter dump_active .. 0 homeless 2024-01-23T08:10:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.439+0000 7fcbc57fa640 1 -- 172.21.15.116:0/2190593771 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fcbbc076570 con 0x7fcbc80a96e0 2024-01-23T08:10:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.439+0000 7fcbc57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:29.438 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.439+0000 7fcbc57fa640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:29.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.607+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbc8138f00 con 0x7fcbac06c860 2024-01-23T08:10:29.607 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.607+0000 7fcbc57fa640 1 -- 172.21.15.116:0/2190593771 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcbb4007e30 con 0x7fcbac06c860 2024-01-23T08:10:29.607 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 1 to deep-scrub 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 10 librados: watch_flush enter 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 10 librados: watch_flush exit 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 20 client.20941.objecter shutdown clearing up homeless session... 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 10 client.20941.objecter successfully canceled tick 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcbac06c860 msgr2=0x7fcbac06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcbac06c860 0x7fcbac06ed20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcbc8145240 tx=0x7fcbb4009040 comp rx=0 tx=0).stop 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 10 monclient: shutdown 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 msgr2=0x7fcbc8144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.610 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc8144be0 secure :-1 s=READY pgs=5220 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc033000 tx=0x7fcbbc0046c0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 shutdown_connections 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fcbac06c860 0x7fcbac06ed20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc8145600 0x7fcbc81360e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fcbc813f390 0x7fcbc8138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 --2- 172.21.15.116:0/2190593771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc80a96e0 0x7fcbc8144be0 unknown :-1 s=CLOSED pgs=5220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 >> 172.21.15.116:0/2190593771 conn(0x7fcbc80b7bb0 msgr2=0x7fcbc81355a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 shutdown_connections 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 -- 172.21.15.116:0/2190593771 wait complete. 2024-01-23T08:10:29.611 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.609+0000 7fcbceb8d640 1 librados: shutdown 2024-01-23T08:10:29.620 INFO:tasks.ceph:Scrubbing osd.2 2024-01-23T08:10:29.621 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:29.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.727+0000 7f2e235f1640 10 monclient: get_monmap_and_config 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.727+0000 7f2e235f1640 10 monclient: build_initial_monmap 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.727+0000 7f2e235f1640 10 monclient: monmap: 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:29.728871+0000 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:29.728871+0000 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:29.728 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.728+0000 7f2e235f1640 1 Processor -- start 2024-01-23T08:10:29.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.728+0000 7f2e235f1640 1 -- start start 2024-01-23T08:10:29.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.728+0000 7f2e235f1640 10 monclient: init 2024-01-23T08:10:29.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.728+0000 7f2e235f1640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:29.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.728+0000 7f2e235f1640 10 monclient: _add_conns ranks=[3,4,0,2,1] 2024-01-23T08:10:29.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2e1c0b4870 0x7f2e1c1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 10 monclient(hunting): picked mon.noname-a con 0x7f2e1c0b4870 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e1c0b41b0 0x7f2e1c145b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 10 monclient(hunting): picked mon.noname-c con 0x7f2e1c0b41b0 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2e1c0a9e00 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0aac10 con 0x7f2e1c0a9e00 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0b4c50 con 0x7f2e1c0b4870 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c0aaef0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.729+0000 7f2e235f1640 10 monclient(hunting): authenticate will time out at 4637.087265s 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.730+0000 7f2e20b8c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e1c0b41b0 0x7f2e1c145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.730+0000 7f2e20b8c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2e1c0b41b0 0x7f2e1c145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:49260/0 (socket says 172.21.15.116:49260) 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.730+0000 7f2e20b8c640 1 -- 172.21.15.116:0/2120329597 learned_addr learned my addr 172.21.15.116:0/2120329597 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.730+0000 7f2e20b8c640 10 monclient(hunting): get_auth_request con 0x7f2e1c0b41b0 auth_method 0 2024-01-23T08:10:29.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.730+0000 7f2e20b8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.730+0000 7f2e20b8c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.730+0000 7f2e20b8c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.731+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.731+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.731+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_done global_id 20944 payload 274 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 1 -- 172.21.15.116:0/2120329597 >> v2:172.21.15.116:3300/0 conn(0x7f2e1c0b4870 msgr2=0x7f2e1c1455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 1 --2- 172.21.15.116:0/2120329597 >> v2:172.21.15.116:3300/0 conn(0x7f2e1c0b4870 0x7f2e1c1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 1 -- 172.21.15.116:0/2120329597 >> v1:172.21.15.116:6789/0 conn(0x7f2e1c0a9e00 legacy=0x7f2e1c13f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 10 monclient: _finish_hunting 0 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 1 monclient: found mon.noname-c 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T08:10:29.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.733+0000 7f2e20b8c640 1 -- 172.21.15.116:0/2120329597 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c0ab1d0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.735+0000 7f2e20b8c640 1 --2- 172.21.15.116:0/2120329597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c145b30 secure :-1 s=READY pgs=5221 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c141ff0 tx=0x7f2e0c02b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc938a44826ada84 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 1 -- 172.21.15.116:0/2120329597 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0317e0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: dump: 2024-01-23T08:10:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.748 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.749 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.749 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: _finish_auth 0 2024-01-23T08:10:29.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:29.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:29.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 5 monclient: authenticate success, global_id 20944 2024-01-23T08:10:29.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 1 -- 172.21.15.116:0/2120329597 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c031940 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 4 set_mon_vals no callback set 2024-01-23T08:10:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 1 -- 172.21.15.116:0/2120329597 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c031cd0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:29.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e13fff640 10 monclient: dump: 2024-01-23T08:10:29.752 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.752 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.752 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.752 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.752 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.752 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.753 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.753 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.753 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.753 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 10 monclient: shutdown 2024-01-23T08:10:29.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:29.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 -- 172.21.15.116:0/2120329597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b41b0 msgr2=0x7f2e1c145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 --2- 172.21.15.116:0/2120329597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c145b30 secure :-1 s=READY pgs=5221 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c141ff0 tx=0x7f2e0c02b880 comp rx=0 tx=0).stop 2024-01-23T08:10:29.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 -- 172.21.15.116:0/2120329597 shutdown_connections 2024-01-23T08:10:29.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 --2- 172.21.15.116:0/2120329597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c145b30 unknown :-1 s=CLOSED pgs=5221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 --2- 172.21.15.116:0/2120329597 >> v2:172.21.15.116:3300/0 conn(0x7f2e1c0b4870 0x7f2e1c1455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 -- 172.21.15.116:0/2120329597 >> 172.21.15.116:0/2120329597 conn(0x7f2e1c066450 msgr2=0x7f2e1c066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:29.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 -- 172.21.15.116:0/2120329597 shutdown_connections 2024-01-23T08:10:29.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.740+0000 7f2e235f1640 1 -- 172.21.15.116:0/2120329597 wait complete. 2024-01-23T08:10:29.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 10 monclient: build_initial_monmap 2024-01-23T08:10:29.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 10 monclient: monmap: 2024-01-23T08:10:29.755 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:29.755 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:29.756 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:29.756 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:29.756 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:29.756 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.756 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:29.756 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:29.757 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:29.757 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 1 librados: starting msgr at 2024-01-23T08:10:29.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 1 librados: starting objecter 2024-01-23T08:10:29.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 1 Processor -- start 2024-01-23T08:10:29.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 1 -- start start 2024-01-23T08:10:29.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 1 librados: setting wanted keys 2024-01-23T08:10:29.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 1 librados: calling monclient init 2024-01-23T08:10:29.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.741+0000 7f2e235f1640 10 monclient: init 2024-01-23T08:10:29.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:29.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T08:10:29.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e1c0a9e00 0x7f2e1c142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): picked mon.noname-c con 0x7f2e1c0a9e00 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:29.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c0b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): picked mon.noname-a con 0x7f2e1c0b41b0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:29.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b4870 0x7f2e1c137fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): picked mon.noname-b con 0x7f2e1c0b4870 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:29.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c142e70 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c1393b0 con 0x7f2e1c0b4870 2024-01-23T08:10:29.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c1dae10 con 0x7f2e1c0a9e00 2024-01-23T08:10:29.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:29.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e235f1640 10 monclient(hunting): authenticate will time out at 4637.100577s 2024-01-23T08:10:29.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e20b8c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c0b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.742+0000 7f2e2138d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e1c0a9e00 0x7f2e1c142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b4870 0x7f2e1c137fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c0b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33830/0 (socket says 172.21.15.116:33830) 2024-01-23T08:10:29.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 1 -- 172.21.15.116:0/1647588165 learned_addr learned my addr 172.21.15.116:0/1647588165 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:29.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 10 monclient(hunting): get_auth_request con 0x7f2e1c0b41b0 auth_method 0 2024-01-23T08:10:29.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 10 monclient(hunting): get_auth_request con 0x7f2e1c0b4870 auth_method 0 2024-01-23T08:10:29.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e2138d640 10 monclient(hunting): get_auth_request con 0x7f2e1c0a9e00 auth_method 0 2024-01-23T08:10:29.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e2138d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:29.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e2138d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:29.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e2138d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:29.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.743+0000 7f2e21b8e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.744+0000 7f2e2138d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:29.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.744+0000 7f2e2138d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:29.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.744+0000 7f2e2138d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:29.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 10 monclient(hunting): handle_auth_done global_id 16545 payload 824 2024-01-23T08:10:29.765 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 1 -- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e1c0a9e00 msgr2=0x7f2e1c142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2e1c0a9e00 0x7f2e1c142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 1 -- 172.21.15.116:0/1647588165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b4870 msgr2=0x7f2e1c137fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e1c0b4870 0x7f2e1c137fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 10 monclient: _finish_hunting 0 2024-01-23T08:10:29.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 1 monclient: found mon.noname-a 2024-01-23T08:10:29.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:29.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:29.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.746+0000 7f2e20b8c640 1 -- 172.21.15.116:0/1647588165 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c0094d0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.749+0000 7f2e20b8c640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c0b8660 secure :-1 s=READY pgs=3243 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c000c00 tx=0x7f2e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.749+0000 7f2e11ffb640 10 client.?.objecter ms_handle_connect 0x7f2e1c0b41b0 2024-01-23T08:10:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.749+0000 7f2e11ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c032940 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:29.771 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: dump: 2024-01-23T08:10:29.771 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.771 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.771 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.771 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.771 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.771 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.772 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.772 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.772 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.772 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:29.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:29.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:29.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c032aa0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 5 monclient: authenticate success, global_id 16545 2024-01-23T08:10:29.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 10 monclient: _renew_subs 2024-01-23T08:10:29.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:29.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c1db030 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:29.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c032e50 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:29.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:29.774 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e11ffb640 10 monclient: dump: 2024-01-23T08:10:29.774 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:29.774 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.775 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.775 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:29.775 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:29.775 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.775 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:29.775 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:29.776 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:29.776 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e12ffd640 4 set_mon_vals no callback set 2024-01-23T08:10:29.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 10 client.16545.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:29.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 10 monclient: _renew_subs 2024-01-23T08:10:29.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:29.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c0b7ce0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.753+0000 7f2e235f1640 1 librados: init done 2024-01-23T08:10:29.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.754+0000 7f2e235f1640 10 client.16545.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:29.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.754+0000 7f2e235f1640 15 client.16545.objecter _session_command_op_assign -1 1 2024-01-23T08:10:29.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.754+0000 7f2e235f1640 20 client.16545.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:29.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.754+0000 7f2e235f1640 10 client.16545.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:29.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.754+0000 7f2e235f1640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:29.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.754+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e1c067d70 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.788+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2e0c0453f0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.788+0000 7f2e11ffb640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2e0006c8b0 0x7f2e0006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.788+0000 7f2e2138d640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2e0006c8b0 0x7f2e0006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.788+0000 7f2e2138d640 10 monclient: get_auth_request con 0x7f2e0006c8b0 auth_method 0 2024-01-23T08:10:29.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.789+0000 7f2e11ffb640 10 client.16545.objecter ms_handle_connect 0x7f2e0006c8b0 2024-01-23T08:10:29.790 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.789+0000 7f2e2138d640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2e0006c8b0 0x7f2e0006ed70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2e180098e0 tx=0x7f2e18009060 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f2e0c07acd0 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.796 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 10 client.16545.objecter ms_dispatch 0x7f2e1c000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 3 client.16545.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 3 client.16545.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 10 client.16545.objecter checking command 1 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f2e00074630 0x7f2e00076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 20 client.16545.objecter _get_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 20 client.16545.objecter put_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 15 client.16545.objecter _session_command_op_remove -1 1 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 20 client.16545.objecter _get_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 20 client.16545.objecter get_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 15 client.16545.objecter _session_command_op_assign 2 1 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 20 client.16545.objecter put_session s=0x7f2e00073f60 osd=2 4 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 10 client.16545.objecter _send_command 1 2024-01-23T08:10:29.797 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 --> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e000771a0 con 0x7f2e00074630 2024-01-23T08:10:29.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 20 client.16545.objecter dump_active .. 0 homeless 2024-01-23T08:10:29.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e0c077010 con 0x7f2e1c0b41b0 2024-01-23T08:10:29.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.796+0000 7f2e11ffb640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:29.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.797+0000 7f2e21b8e640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f2e00074630 0x7f2e00076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:29.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.797+0000 7f2e21b8e640 10 monclient: get_auth_request con 0x7f2e00074630 auth_method 0 2024-01-23T08:10:29.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.800+0000 7f2e11ffb640 10 client.16545.objecter ms_handle_connect 0x7f2e00074630 2024-01-23T08:10:29.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.800+0000 7f2e21b8e640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f2e00074630 0x7f2e00076ad0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.825+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== osd.2 v2:172.21.15.116:6826/2848377313 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2e000771a0 con 0x7f2e00074630 2024-01-23T08:10:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.825+0000 7f2e11ffb640 10 client.16545.objecter ms_dispatch 0x7f2e1c000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.825+0000 7f2e11ffb640 10 client.16545.objecter _finish_command 1 = system:0 2024-01-23T08:10:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.825+0000 7f2e11ffb640 20 client.16545.objecter put_session s=0x7f2e00073f60 osd=2 4 2024-01-23T08:10:29.825 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.825+0000 7f2e11ffb640 15 client.16545.objecter _session_command_op_remove 2 1 2024-01-23T08:10:29.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 10 client.16545.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:29.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 15 client.16545.objecter _session_command_op_assign -1 2 2024-01-23T08:10:29.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 20 client.16545.objecter _get_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 20 client.16545.objecter put_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 20 client.16545.objecter _get_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 15 client.16545.objecter _session_command_op_remove -1 2 2024-01-23T08:10:29.838 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 20 client.16545.objecter get_session s=0x7f2e00073f60 osd=2 3 2024-01-23T08:10:29.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 15 client.16545.objecter _session_command_op_assign 2 2 2024-01-23T08:10:29.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 20 client.16545.objecter put_session s=0x7f2e00073f60 osd=2 4 2024-01-23T08:10:29.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 10 client.16545.objecter _send_command 2 2024-01-23T08:10:29.839 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.838+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 --> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e1c0b78c0 con 0x7f2e00074630 2024-01-23T08:10:29.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e11ffb640 1 -- 172.21.15.116:0/1647588165 <== osd.2 v2:172.21.15.116:6826/2848377313 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2e1c0b78c0 con 0x7f2e00074630 2024-01-23T08:10:29.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e11ffb640 10 client.16545.objecter ms_dispatch 0x7f2e1c000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:29.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e11ffb640 10 client.16545.objecter _finish_command 2 = system:0 2024-01-23T08:10:29.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e11ffb640 20 client.16545.objecter put_session s=0x7f2e00073f60 osd=2 4 2024-01-23T08:10:29.851 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e11ffb640 15 client.16545.objecter _session_command_op_remove 2 2 2024-01-23T08:10:29.852 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:29.852 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:29.852 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:29.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 10 librados: watch_flush enter 2024-01-23T08:10:29.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 10 librados: watch_flush exit 2024-01-23T08:10:29.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 10 client.16545.objecter close_session for osd.2 2024-01-23T08:10:29.853 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f2e00074630 msgr2=0x7f2e00076ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6826/2848377313,v1:172.21.15.116:6827/2848377313] conn(0x7f2e00074630 0x7f2e00076ad0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 20 client.16545.objecter put_session s=0x7f2e00073f60 osd=2 1 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 20 client.16545.objecter shutdown clearing up homeless session... 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 10 client.16545.objecter successfully canceled tick 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2e0006c8b0 msgr2=0x7f2e0006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2e0006c8b0 0x7f2e0006ed70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2e180098e0 tx=0x7f2e18009060 comp rx=0 tx=0).stop 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 10 monclient: shutdown 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.851+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e1c0b41b0 msgr2=0x7f2e1c0b8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.852+0000 7f2e235f1640 1 --2- 172.21.15.116:0/1647588165 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2e1c0b41b0 0x7f2e1c0b8660 secure :-1 s=READY pgs=3243 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c000c00 tx=0x7f2e0c0046c0 comp rx=0 tx=0).stop 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.852+0000 7f2e21b8e640 1 -- 172.21.15.116:0/1647588165 reap_dead start 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.852+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 shutdown_connections 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.852+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 >> 172.21.15.116:0/1647588165 conn(0x7f2e1c066450 msgr2=0x7f2e1c13c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:29.854 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.852+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 shutdown_connections 2024-01-23T08:10:29.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.852+0000 7f2e235f1640 1 -- 172.21.15.116:0/1647588165 wait complete. 2024-01-23T08:10:29.855 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.852+0000 7f2e235f1640 1 librados: shutdown 2024-01-23T08:10:29.862 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-23T08:10:29.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.968+0000 7fee18d7c640 10 monclient: get_monmap_and_config 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.968+0000 7fee18d7c640 10 monclient: build_initial_monmap 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.968+0000 7fee18d7c640 10 monclient: monmap: 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:29.970063+0000 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:29.970063+0000 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:29.969 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:29.970 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.969+0000 7fee18d7c640 1 Processor -- start 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.969+0000 7fee18d7c640 1 -- start start 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.969+0000 7fee18d7c640 10 monclient: init 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient: _add_conns ranks=[4,1,2,3,0] 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fee140b4890 0x7fee1413f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient(hunting): picked mon.noname-c con 0x7fee140b4890 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fee140b1ff0 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee14145c00 0x7fee1413f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient(hunting): picked mon.noname-b con 0x7fee14145c00 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee140a9d70 con 0x7fee140b1ff0 2024-01-23T08:10:29.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee140b4c70 con 0x7fee140b4890 2024-01-23T08:10:29.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:29.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee140ab0f0 con 0x7fee14145c00 2024-01-23T08:10:29.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:29.972 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:29.970+0000 7fee18d7c640 10 monclient(hunting): authenticate will time out at 4637.328980s 2024-01-23T08:10:30.009 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.009+0000 7fee12d9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee14145c00 0x7fee1413f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.009+0000 7fee12d9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee14145c00 0x7fee1413f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48476/0 (socket says 172.21.15.116:48476) 2024-01-23T08:10:30.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.009+0000 7fee12d9d640 1 -- 172.21.15.116:0/2079407534 learned_addr learned my addr 172.21.15.116:0/2079407534 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:30.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.009+0000 7fee12d9d640 10 monclient(hunting): get_auth_request con 0x7fee14145c00 auth_method 0 2024-01-23T08:10:30.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.009+0000 7fee12d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.009+0000 7fee12d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.009+0000 7fee12d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.010 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee1259c640 1 --2- 172.21.15.116:0/2079407534 >> v2:172.21.15.173:3300/0 conn(0x7fee140b4890 0x7fee1413f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee1259c640 10 monclient(hunting): get_auth_request con 0x7fee140b4890 auth_method 0 2024-01-23T08:10:30.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee1259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee1259c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee1259c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee12d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee12d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.011 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.010+0000 7fee12d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.011+0000 7fee1259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.011+0000 7fee1259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.011+0000 7fee1259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 10 monclient(hunting): handle_auth_done global_id 28457 payload 274 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 1 -- 172.21.15.116:0/2079407534 >> v2:172.21.15.173:3300/0 conn(0x7fee140b4890 msgr2=0x7fee1413f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 1 --2- 172.21.15.116:0/2079407534 >> v2:172.21.15.173:3300/0 conn(0x7fee140b4890 0x7fee1413f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 1 -- 172.21.15.116:0/2079407534 >> v1:172.21.15.173:6789/0 conn(0x7fee140b1ff0 legacy=0x7fee141454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 10 monclient: _finish_hunting 0 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 1 monclient: found mon.noname-b 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.012+0000 7fee12d9d640 1 -- 172.21.15.116:0/2079407534 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140a9920 con 0x7fee14145c00 2024-01-23T08:10:30.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.014+0000 7fee12d9d640 1 --2- 172.21.15.116:0/2079407534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee14145c00 0x7fee1413f540 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61593404c96902e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 1 -- 172.21.15.116:0/2079407534 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee040317c0 con 0x7fee14145c00 2024-01-23T08:10:30.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:30.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: dump: 2024-01-23T08:10:30.020 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.020 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.020 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.020 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.020 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.020 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: _finish_auth 0 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: _check_auth_tickets 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 1 -- 172.21.15.116:0/2079407534 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04031920 con 0x7fee14145c00 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee18d7c640 5 monclient: authenticate success, global_id 28457 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee18d7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:30.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 1 -- 172.21.15.116:0/2079407534 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04031cb0 con 0x7fee14145c00 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee18d7c640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee18d7c640 4 set_mon_vals no callback set 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.019+0000 7fee1159a640 10 monclient: dump: 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.022 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.023 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.023 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 10 monclient: shutdown 2024-01-23T08:10:30.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:30.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 -- 172.21.15.116:0/2079407534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee14145c00 msgr2=0x7fee1413f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2079407534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee14145c00 0x7fee1413f540 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee0402b860 comp rx=0 tx=0).stop 2024-01-23T08:10:30.028 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 -- 172.21.15.116:0/2079407534 shutdown_connections 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2079407534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee14145c00 0x7fee1413f540 unknown :-1 s=CLOSED pgs=3327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2079407534 >> v2:172.21.15.173:3300/0 conn(0x7fee140b4890 0x7fee1413f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 -- 172.21.15.116:0/2079407534 >> 172.21.15.116:0/2079407534 conn(0x7fee14066450 msgr2=0x7fee14066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 -- 172.21.15.116:0/2079407534 shutdown_connections 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.020+0000 7fee18d7c640 1 -- 172.21.15.116:0/2079407534 wait complete. 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.021+0000 7fee18d7c640 10 monclient: build_initial_monmap 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.021+0000 7fee18d7c640 10 monclient: monmap: 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:30.029 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.021+0000 7fee18d7c640 1 librados: starting msgr at 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.021+0000 7fee18d7c640 1 librados: starting objecter 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 Processor -- start 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 -- start start 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 librados: setting wanted keys 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 librados: calling monclient init 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient: init 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee140b1ff0 0x7fee14140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): picked mon.noname-a con 0x7fee140b1ff0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:30.030 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee140b4890 0x7fee141da8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): picked mon.noname-c con 0x7fee140b4890 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14145c00 0x7fee141dae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): picked mon.noname-b con 0x7fee14145c00 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee141db360 con 0x7fee140b1ff0 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee141da450 con 0x7fee14145c00 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee14138900 con 0x7fee140b4890 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.022+0000 7fee18d7c640 10 monclient(hunting): authenticate will time out at 4637.380987s 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.025+0000 7fee1259c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee140b1ff0 0x7fee14140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.025+0000 7fee12d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14145c00 0x7fee141dae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.025+0000 7fee12d9d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14145c00 0x7fee141dae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.116:49276/0 (socket says 172.21.15.116:49276) 2024-01-23T08:10:30.031 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.026+0000 7fee12d9d640 1 -- 172.21.15.116:0/2510875633 learned_addr learned my addr 172.21.15.116:0/2510875633 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.026+0000 7fee12d9d640 10 monclient(hunting): get_auth_request con 0x7fee14145c00 auth_method 0 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.026+0000 7fee12d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.026+0000 7fee12d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.026+0000 7fee12d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.027+0000 7fee11d9b640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee140b4890 0x7fee141da8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.028+0000 7fee11d9b640 10 monclient(hunting): get_auth_request con 0x7fee140b4890 auth_method 0 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.028+0000 7fee11d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.028+0000 7fee11d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.032 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.028+0000 7fee11d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.071+0000 7fee11d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.071+0000 7fee11d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.071+0000 7fee11d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.071+0000 7fee1259c640 10 monclient(hunting): get_auth_request con 0x7fee140b1ff0 auth_method 0 2024-01-23T08:10:30.071 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.071+0000 7fee1259c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.071+0000 7fee1259c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.071+0000 7fee1259c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.072+0000 7fee1259c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.072 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.072+0000 7fee1259c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.072+0000 7fee1259c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.072+0000 7fee12d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.072+0000 7fee12d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.073 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.072+0000 7fee12d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 10 monclient(hunting): handle_auth_done global_id 20953 payload 824 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 1 -- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee140b4890 msgr2=0x7fee141da8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee140b4890 0x7fee141da8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 1 -- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee140b1ff0 msgr2=0x7fee14140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee140b1ff0 0x7fee14140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 10 monclient: _finish_hunting 0 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 1 monclient: found mon.noname-b 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:30.075 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.075+0000 7fee12d9d640 1 -- 172.21.15.116:0/2510875633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040094d0 con 0x7fee14145c00 2024-01-23T08:10:30.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.077+0000 7fee12d9d640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14145c00 0x7fee141dae20 secure :-1 s=READY pgs=5223 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee040046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.077+0000 7fee02ffd640 10 client.?.objecter ms_handle_connect 0x7fee14145c00 2024-01-23T08:10:30.077 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.077+0000 7fee02ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:30.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 1 -- 172.21.15.116:0/2510875633 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04032860 con 0x7fee14145c00 2024-01-23T08:10:30.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:30.081 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: dump: 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: _finish_auth 0 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 1 -- 172.21.15.116:0/2510875633 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04031f00 con 0x7fee14145c00 2024-01-23T08:10:30.082 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 5 monclient: authenticate success, global_id 20953 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 1 -- 172.21.15.116:0/2510875633 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04032c40 con 0x7fee14145c00 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 10 monclient: _renew_subs 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee140b43f0 con 0x7fee14145c00 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee10d99640 4 set_mon_vals no callback set 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee02ffd640 10 monclient: dump: 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.083 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 10 client.20953.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 10 monclient: _renew_subs 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee14142da0 con 0x7fee14145c00 2024-01-23T08:10:30.084 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.081+0000 7fee18d7c640 1 librados: init done 2024-01-23T08:10:30.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.082+0000 7fee18d7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:30.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.082+0000 7fee18d7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:30.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.082+0000 7fee18d7c640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:30.085 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.082+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee141da5c0 con 0x7fee14145c00 2024-01-23T08:10:30.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.103+0000 7fee02ffd640 1 -- 172.21.15.116:0/2510875633 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fee0404e450 con 0x7fee14145c00 2024-01-23T08:10:30.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.103+0000 7fee02ffd640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fedf406c8b0 0x7fedf406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.103+0000 7fee1259c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fedf406c8b0 0x7fedf406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.103 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.103+0000 7fee1259c640 10 monclient: get_auth_request con 0x7fedf406c8b0 auth_method 0 2024-01-23T08:10:30.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.104+0000 7fee1259c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fedf406c8b0 0x7fedf406ed70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009b40 tx=0x7fee0c009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.104 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.104+0000 7fee02ffd640 10 client.20953.objecter ms_handle_connect 0x7fedf406c8b0 2024-01-23T08:10:30.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.105+0000 7fee02ffd640 1 -- 172.21.15.116:0/2510875633 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fee0407a6e0 con 0x7fee14145c00 2024-01-23T08:10:30.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.105+0000 7fee02ffd640 10 client.20953.objecter ms_dispatch 0x7fee14000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:30.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.105+0000 7fee02ffd640 3 client.20953.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:30.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.105+0000 7fee02ffd640 3 client.20953.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:30.107 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.105+0000 7fee02ffd640 20 client.20953.objecter dump_active .. 0 homeless 2024-01-23T08:10:30.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.341+0000 7fee02ffd640 1 -- 172.21.15.116:0/2510875633 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fee04076a20 con 0x7fee14145c00 2024-01-23T08:10:30.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.341+0000 7fee02ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:30.341 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.341+0000 7fee02ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:30.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.509+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fee140aa150 con 0x7fedf406c8b0 2024-01-23T08:10:30.509 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.509+0000 7fee02ffd640 1 -- 172.21.15.116:0/2510875633 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee140aa150 con 0x7fedf406c8b0 2024-01-23T08:10:30.510 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 2 to deep-scrub 2024-01-23T08:10:30.512 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 10 librados: watch_flush enter 2024-01-23T08:10:30.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 10 librados: watch_flush exit 2024-01-23T08:10:30.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 20 client.20953.objecter shutdown clearing up homeless session... 2024-01-23T08:10:30.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 10 client.20953.objecter successfully canceled tick 2024-01-23T08:10:30.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fedf406c8b0 msgr2=0x7fedf406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.513 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fedf406c8b0 0x7fedf406ed70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009b40 tx=0x7fee0c009190 comp rx=0 tx=0).stop 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 10 monclient: shutdown 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14145c00 msgr2=0x7fee141dae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14145c00 0x7fee141dae20 secure :-1 s=READY pgs=5223 cs=0 l=1 rev1=1 crypto rx=0x7fee04009870 tx=0x7fee040046c0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 shutdown_connections 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fedf406c8b0 0x7fedf406ed70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14145c00 0x7fee141dae20 unknown :-1 s=CLOSED pgs=5223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fee140b4890 0x7fee141da8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 --2- 172.21.15.116:0/2510875633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fee140b1ff0 0x7fee14140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 >> 172.21.15.116:0/2510875633 conn(0x7fee14066450 msgr2=0x7fee140b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:30.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 shutdown_connections 2024-01-23T08:10:30.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 -- 172.21.15.116:0/2510875633 wait complete. 2024-01-23T08:10:30.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.511+0000 7fee18d7c640 1 librados: shutdown 2024-01-23T08:10:30.523 INFO:tasks.ceph:Scrubbing osd.3 2024-01-23T08:10:30.523 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:30.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.629+0000 7f5732c09640 10 monclient: get_monmap_and_config 2024-01-23T08:10:30.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.629+0000 7f5732c09640 10 monclient: build_initial_monmap 2024-01-23T08:10:30.629 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.629+0000 7f5732c09640 10 monclient: monmap: 2024-01-23T08:10:30.629 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:30.629 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:30.630670+0000 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:30.630670+0000 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:30.630 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 1 Processor -- start 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 1 -- start start 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient: init 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient: _add_conns ranks=[2,1,0,4,3] 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c0ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient(hunting): picked mon.noname-b con 0x7f572c0ae420 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f572c0ab910 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:30.632 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f572c0aa580 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c13c960 con 0x7f572c0aa580 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0ade90 con 0x7f572c0ab910 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0ae800 con 0x7f572c0ae420 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.630+0000 7f5732c09640 10 monclient(hunting): authenticate will time out at 4637.989038s 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f57309a5640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c0ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f572bfff640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f572c0ab910 0x7f572c13ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42158/0 (socket says 172.21.15.116:42158) 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f57311a6640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f572c0aa580 0x7f572c149540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51772/0 (socket says 172.21.15.116:51772) 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f572bfff640 1 -- 172.21.15.116:0/196248829 learned_addr learned my addr 172.21.15.116:0/196248829 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f57309a5640 10 monclient(hunting): get_auth_request con 0x7f572c0ae420 auth_method 0 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f57309a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f57309a5640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.631+0000 7f57309a5640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.633 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.632+0000 7f57309a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.632+0000 7f57309a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.632+0000 7f57309a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f572b7fe640 1 -- 172.21.15.116:0/196248829 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80779010 0 0) 0x7f572c0ade90 con 0x7f572c0ab910 2024-01-23T08:10:30.634 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f572b7fe640 10 monclient(hunting): _negotiate 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f572b7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f572b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f572b7fe640 10 monclient(hunting): my global_id is 20956 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f572b7fe640 1 -- 172.21.15.116:0/196248829 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f571c005730 con 0x7f572c0ab910 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 10 monclient(hunting): handle_auth_done global_id 28463 payload 274 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 1 -- 172.21.15.116:0/196248829 >> v1:172.21.15.173:6789/0 conn(0x7f572c0ab910 legacy=0x7f572c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 1 -- 172.21.15.116:0/196248829 >> v1:172.21.15.116:6789/0 conn(0x7f572c0aa580 legacy=0x7f572c149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 10 monclient: _finish_hunting 0 2024-01-23T08:10:30.635 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 1 monclient: found mon.noname-b 2024-01-23T08:10:30.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:30.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.634+0000 7f57309a5640 1 -- 172.21.15.116:0/196248829 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0acc50 con 0x7f572c0ae420 2024-01-23T08:10:30.636 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.636+0000 7f57309a5640 1 --2- 172.21.15.116:0/196248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c0ad950 secure :-1 s=READY pgs=3328 cs=0 l=1 rev1=1 crypto rx=0x7f57200097d0 tx=0x7f572002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ae0df633789b81 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.642 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 1 -- 172.21.15.116:0/196248829 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720031890 con 0x7f572c0ae420 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: dump: 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.643 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: _finish_auth 0 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: _check_auth_tickets 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 1 -- 172.21.15.116:0/196248829 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57200319f0 con 0x7f572c0ae420 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f5732c09640 5 monclient: authenticate success, global_id 28463 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f5732c09640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f5732c09640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f5732c09640 4 set_mon_vals no callback set 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 1 -- 172.21.15.116:0/196248829 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720031d80 con 0x7f572c0ae420 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.644 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.641+0000 7f572b7fe640 10 monclient: dump: 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 10 monclient: shutdown 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:30.645 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 1 -- 172.21.15.116:0/196248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 msgr2=0x7f572c0ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 1 --2- 172.21.15.116:0/196248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c0ad950 secure :-1 s=READY pgs=3328 cs=0 l=1 rev1=1 crypto rx=0x7f57200097d0 tx=0x7f572002b930 comp rx=0 tx=0).stop 2024-01-23T08:10:30.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 1 -- 172.21.15.116:0/196248829 shutdown_connections 2024-01-23T08:10:30.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 1 --2- 172.21.15.116:0/196248829 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c0ad950 unknown :-1 s=CLOSED pgs=3328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 1 -- 172.21.15.116:0/196248829 >> 172.21.15.116:0/196248829 conn(0x7f572c0b08e0 msgr2=0x7f572c06a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:30.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 1 -- 172.21.15.116:0/196248829 shutdown_connections 2024-01-23T08:10:30.646 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.642+0000 7f5732c09640 1 -- 172.21.15.116:0/196248829 wait complete. 2024-01-23T08:10:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.643+0000 7f5732c09640 10 monclient: build_initial_monmap 2024-01-23T08:10:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.643+0000 7f5732c09640 10 monclient: monmap: 2024-01-23T08:10:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:30.649 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.643+0000 7f5732c09640 1 librados: starting msgr at 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.643+0000 7f5732c09640 1 librados: starting objecter 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 Processor -- start 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 -- start start 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 librados: setting wanted keys 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 librados: calling monclient init 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient: init 2024-01-23T08:10:30.650 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c0aa580 0x7f572c1397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): picked mon.noname-a con 0x7f572c0aa580 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c0ab910 0x7f572c1da9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): picked mon.noname-b con 0x7f572c0ab910 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): picked mon.noname-c con 0x7f572c0ae420 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1daf20 con 0x7f572c0aa580 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1200e0 con 0x7f572c0ab910 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1db1e0 con 0x7f572c0ae420 2024-01-23T08:10:30.651 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.644+0000 7f5732c09640 10 monclient(hunting): authenticate will time out at 4638.003005s 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57309a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c0aa580 0x7f572c1397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57311a6640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f572bfff640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c0ab910 0x7f572c1da9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57309a5640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c0aa580 0x7f572c1397c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33850/0 (socket says 172.21.15.116:33850) 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57309a5640 1 -- 172.21.15.116:0/4104566372 learned_addr learned my addr 172.21.15.116:0/4104566372 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57309a5640 10 monclient(hunting): get_auth_request con 0x7f572c0aa580 auth_method 0 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57309a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57309a5640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57309a5640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57311a6640 10 monclient(hunting): get_auth_request con 0x7f572c0ae420 auth_method 0 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57311a6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57311a6640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.652 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f57311a6640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f572bfff640 10 monclient(hunting): get_auth_request con 0x7f572c0ab910 auth_method 0 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f572bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f572bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.645+0000 7f572bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f57309a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f57309a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f57309a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f572bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f572bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f572bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f57311a6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f57311a6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.646+0000 7f57311a6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.653 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 10 monclient(hunting): handle_auth_done global_id 28466 payload 824 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 1 -- 172.21.15.116:0/4104566372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c0ab910 msgr2=0x7f572c1da9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c0ab910 0x7f572c1da9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 1 -- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c0aa580 msgr2=0x7f572c1397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c0aa580 0x7f572c1397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 10 monclient: _finish_hunting 0 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 1 monclient: found mon.noname-c 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57311a6640 1 -- 172.21.15.116:0/4104566372 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5720009400 con 0x7f572c0ae420 2024-01-23T08:10:30.654 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.648+0000 7f57309a5640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f572c0aa580 0x7f572c1397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:10:30.655 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.651+0000 7f57311a6640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c06f9b0 secure :-1 s=READY pgs=3329 cs=0 l=1 rev1=1 crypto rx=0x7f572400c6c0 tx=0x7f572400cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.651+0000 7f57297fa640 10 client.?.objecter ms_handle_connect 0x7f572c0ae420 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.651+0000 7f57297fa640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5724004d60 con 0x7f572c0ae420 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: dump: 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.656 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: _finish_auth 0 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: _check_auth_tickets 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400a640 con 0x7f572c0ae420 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 5 monclient: authenticate success, global_id 28466 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 10 monclient: _renew_subs 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c13a260 con 0x7f572c0ae420 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:30.657 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572400a9f0 con 0x7f572c0ae420 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f57297fa640 10 monclient: dump: 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.658 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f572affd640 4 set_mon_vals no callback set 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 10 client.28466.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 10 monclient: _renew_subs 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c0700d0 con 0x7f572c0ae420 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.654+0000 7f5732c09640 1 librados: init done 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.655+0000 7f5732c09640 10 client.28466.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.655+0000 7f5732c09640 15 client.28466.objecter _session_command_op_assign -1 1 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.655+0000 7f5732c09640 20 client.28466.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.655+0000 7f5732c09640 10 client.28466.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.655+0000 7f5732c09640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.659 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.655+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f572c0aa9b0 con 0x7f572c0ae420 2024-01-23T08:10:30.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.676+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f572400ab50 con 0x7f572c0ae420 2024-01-23T08:10:30.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.677+0000 7f57297fa640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f571006c8b0 0x7f571006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.677+0000 7f57309a5640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f571006c8b0 0x7f571006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.677+0000 7f57309a5640 10 monclient: get_auth_request con 0x7f571006c8b0 auth_method 0 2024-01-23T08:10:30.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.677+0000 7f57297fa640 10 client.28466.objecter ms_handle_connect 0x7f571006c8b0 2024-01-23T08:10:30.677 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.677+0000 7f57309a5640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f571006c8b0 0x7f571006ed70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5720000c00 tx=0x7f572003c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f5724057db0 con 0x7f572c0ae420 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 10 client.28466.objecter ms_dispatch 0x7f572c000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 3 client.28466.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 3 client.28466.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 10 client.28466.objecter checking command 1 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7f5710074630 0x7f5710076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 20 client.28466.objecter _get_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 20 client.28466.objecter put_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 15 client.28466.objecter _session_command_op_remove -1 1 2024-01-23T08:10:30.680 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 20 client.28466.objecter _get_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 20 client.28466.objecter get_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 15 client.28466.objecter _session_command_op_assign 3 1 2024-01-23T08:10:30.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 20 client.28466.objecter put_session s=0x7f5710073f60 osd=3 4 2024-01-23T08:10:30.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 10 client.28466.objecter _send_command 1 2024-01-23T08:10:30.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57100771a0 con 0x7f5710074630 2024-01-23T08:10:30.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f57297fa640 20 client.28466.objecter dump_active .. 0 homeless 2024-01-23T08:10:30.681 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.680+0000 7f572bfff640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7f5710074630 0x7f5710076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.681+0000 7f572bfff640 10 monclient: get_auth_request con 0x7f5710074630 auth_method 0 2024-01-23T08:10:30.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.681+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57240540f0 con 0x7f572c0ae420 2024-01-23T08:10:30.682 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.681+0000 7f57297fa640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:30.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.688+0000 7f572bfff640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7f5710074630 0x7f5710076ad0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.688+0000 7f57297fa640 10 client.28466.objecter ms_handle_connect 0x7f5710074630 2024-01-23T08:10:30.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.713+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== osd.3 v2:172.21.15.116:6818/1332739445 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f57100771a0 con 0x7f5710074630 2024-01-23T08:10:30.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.713+0000 7f57297fa640 10 client.28466.objecter ms_dispatch 0x7f572c000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:30.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.713+0000 7f57297fa640 10 client.28466.objecter _finish_command 1 = system:0 2024-01-23T08:10:30.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.713+0000 7f57297fa640 20 client.28466.objecter put_session s=0x7f5710073f60 osd=3 4 2024-01-23T08:10:30.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.713+0000 7f57297fa640 15 client.28466.objecter _session_command_op_remove 3 1 2024-01-23T08:10:30.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 10 client.28466.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:30.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 15 client.28466.objecter _session_command_op_assign -1 2 2024-01-23T08:10:30.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 20 client.28466.objecter _get_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 20 client.28466.objecter put_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 20 client.28466.objecter _get_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 15 client.28466.objecter _session_command_op_remove -1 2 2024-01-23T08:10:30.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 20 client.28466.objecter get_session s=0x7f5710073f60 osd=3 3 2024-01-23T08:10:30.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 15 client.28466.objecter _session_command_op_assign 3 2 2024-01-23T08:10:30.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 20 client.28466.objecter put_session s=0x7f5710073f60 osd=3 4 2024-01-23T08:10:30.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 10 client.28466.objecter _send_command 2 2024-01-23T08:10:30.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.726+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 --> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f572c0b11a0 con 0x7f5710074630 2024-01-23T08:10:30.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f57297fa640 1 -- 172.21.15.116:0/4104566372 <== osd.3 v2:172.21.15.116:6818/1332739445 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f572c0b11a0 con 0x7f5710074630 2024-01-23T08:10:30.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f57297fa640 10 client.28466.objecter ms_dispatch 0x7f572c000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:30.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f57297fa640 10 client.28466.objecter _finish_command 2 = system:0 2024-01-23T08:10:30.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f57297fa640 20 client.28466.objecter put_session s=0x7f5710073f60 osd=3 4 2024-01-23T08:10:30.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f57297fa640 15 client.28466.objecter _session_command_op_remove 3 2 2024-01-23T08:10:30.744 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:30.744 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:30.744 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f5732c09640 10 librados: watch_flush enter 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f5732c09640 10 librados: watch_flush exit 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f5732c09640 10 client.28466.objecter close_session for osd.3 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7f5710074630 msgr2=0x7f5710076ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f5732c09640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6818/1332739445,v1:172.21.15.116:6819/1332739445] conn(0x7f5710074630 0x7f5710076ad0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.743+0000 7f5732c09640 20 client.28466.objecter put_session s=0x7f5710073f60 osd=3 1 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 20 client.28466.objecter shutdown clearing up homeless session... 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 10 client.28466.objecter successfully canceled tick 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f571006c8b0 msgr2=0x7f571006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f571006c8b0 0x7f571006ed70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5720000c00 tx=0x7f572003c040 comp rx=0 tx=0).stop 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 10 monclient: shutdown 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 msgr2=0x7f572c06f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 --2- 172.21.15.116:0/4104566372 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f572c0ae420 0x7f572c06f9b0 secure :-1 s=READY pgs=3329 cs=0 l=1 rev1=1 crypto rx=0x7f572400c6c0 tx=0x7f572400cb80 comp rx=0 tx=0).stop 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f57311a6640 1 -- 172.21.15.116:0/4104566372 reap_dead start 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 shutdown_connections 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 >> 172.21.15.116:0/4104566372 conn(0x7f572c0b08e0 msgr2=0x7f572c13bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 shutdown_connections 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 -- 172.21.15.116:0/4104566372 wait complete. 2024-01-23T08:10:30.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.744+0000 7f5732c09640 1 librados: shutdown 2024-01-23T08:10:30.752 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:19.132 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.755 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-23T08:10:30.798 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:19.135 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.807 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:19.187 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.810 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:19.146 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.840 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:19.176 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.842 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:19.220 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.853 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:19.233 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.860 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:19.240 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.863+0000 7febe27d0640 10 monclient: get_monmap_and_config 2024-01-23T08:10:30.863 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.863+0000 7febe27d0640 10 monclient: build_initial_monmap 2024-01-23T08:10:30.864 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.863+0000 7febe27d0640 10 monclient: monmap: 2024-01-23T08:10:30.864 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:30.864 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.864 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:30.865069+0000 2024-01-23T08:10:30.864 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:30.865069+0000 2024-01-23T08:10:30.864 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:30.864 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.865 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:30.865 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:30.865 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:30.865 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:30.865 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:30.865 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.864+0000 7febe27d0640 1 Processor -- start 2024-01-23T08:10:30.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.864+0000 7febe27d0640 1 -- start start 2024-01-23T08:10:30.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.864+0000 7febe27d0640 10 monclient: init 2024-01-23T08:10:30.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:30.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient: _add_conns ranks=[2,0,1,3,4] 2024-01-23T08:10:30.867 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 0x7febdc0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient(hunting): picked mon.noname-b con 0x7febdc0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7febdc13f390 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7febdc145600 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc0aac10 con 0x7febdc13f390 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc0a9ac0 con 0x7febdc145600 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0a9e00 con 0x7febdc0a96e0 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:30.868 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.865+0000 7febe27d0640 10 monclient(hunting): authenticate will time out at 4638.223614s 2024-01-23T08:10:30.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.869+0000 7febdb7fe640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7febdc13f390 0x7febdc13f7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51774/0 (socket says 172.21.15.116:51774) 2024-01-23T08:10:30.869 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.869+0000 7febdb7fe640 1 -- 172.21.15.116:0/2614401371 learned_addr learned my addr 172.21.15.116:0/2614401371 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:30.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.876+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005331151 0 0) 0x7febdc0aac10 con 0x7febdc13f390 2024-01-23T08:10:30.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.876+0000 7febdaffd640 10 monclient(hunting): _negotiate 2024-01-23T08:10:30.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.876+0000 7febdaffd640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.876+0000 7febdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.876+0000 7febdaffd640 10 monclient(hunting): my global_id is 16557 2024-01-23T08:10:30.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.876+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc4003520 con 0x7febdc13f390 2024-01-23T08:10:30.881 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.881+0000 7febdbfff640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 0x7febdc0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.882+0000 7febdbfff640 10 monclient(hunting): get_auth_request con 0x7febdc0a96e0 auth_method 0 2024-01-23T08:10:30.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.882+0000 7febdbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.883 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.882+0000 7febdbfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.884 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.882+0000 7febdbfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.883+0000 7febdbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.883+0000 7febdbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.887 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.883+0000 7febdbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 <== mon.0 v1:172.21.15.116:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856454601 0 0) 0x7febc4003520 con 0x7febdc13f390 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 msgr2=0x7febdc0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 0x7febdc0b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 >> v1:172.21.15.173:6789/0 conn(0x7febdc145600 legacy=0x7febdc145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: _finish_hunting 0 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 monclient: found mon.noname-a-legacy 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:172.21.15.116:6789/0 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 --> v1:172.21.15.116:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0aae80 con 0x7febdc13f390 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: _finish_auth 0 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 <== mon.0 v1:172.21.15.116:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4041568432 0 0) 0x7febd00017f0 con 0x7febdc13f390 2024-01-23T08:10:30.888 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: dump: 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 monclient: mon.a has (v2) addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] but i'm connected to v1:172.21.15.116:6789/0, reconnecting 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:30.889 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 >> v1:172.21.15.116:6789/0 conn(0x7febdc13f390 legacy=0x7febdc13f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T08:10:30.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febc40039a0 0x7febc4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): picked mon.a con 0x7febc40039a0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:30.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 0x7febc40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.890 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): picked mon.c con 0x7febdc0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc4004d00 0x7febc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): picked mon.b con 0x7febc4004d00 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc0a9e00 con 0x7febc40039a0 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc400ba30 con 0x7febc4004d00 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc400bbf0 con 0x7febdc0a96e0 2024-01-23T08:10:30.891 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:30.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.884+0000 7febdaffd640 10 monclient(hunting): _finish_auth 0 2024-01-23T08:10:30.892 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.892+0000 7febdb7fe640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 0x7febc40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.894+0000 7febdb7fe640 10 monclient(hunting): get_auth_request con 0x7febdc0a96e0 auth_method 0 2024-01-23T08:10:30.894 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.894+0000 7febdb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.894+0000 7febdb7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.894+0000 7febdb7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T08:10:30.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.894+0000 7febdb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.894+0000 7febdb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.895 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.894+0000 7febdb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 10 monclient(hunting): handle_auth_done global_id 16557 payload 293 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 1 -- 172.21.15.116:0/2614401371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc4004d00 msgr2=0x7febc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febc4004d00 0x7febc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 1 -- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febc40039a0 msgr2=0x7febc4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febc40039a0 0x7febc4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 10 monclient: _finish_hunting 0 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 1 monclient: found mon.c 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 1 -- 172.21.15.116:0/2614401371 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4003520 con 0x7febdc0a96e0 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 10 monclient: _finish_auth 0 2024-01-23T08:10:30.897 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 10 monclient: _check_auth_tickets 2024-01-23T08:10:30.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febdb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:30.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febe27d0640 5 monclient: authenticate success, global_id 16557 2024-01-23T08:10:30.898 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.896+0000 7febe27d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:30.899 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:19.279 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:30.901 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.901+0000 7febdb7fe640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 0x7febc40047c0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7febd000c0e0 tx=0x7febc40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e49bba6b456c608f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.907+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0007270 con 0x7febdc0a96e0 2024-01-23T08:10:30.907 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.907+0000 7febdaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.907+0000 7febdaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.907+0000 7febdaffd640 10 monclient: dump: 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.908 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.907+0000 7febe27d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:30.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd00073d0 con 0x7febdc0a96e0 2024-01-23T08:10:30.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febdaffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:30.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febdaffd640 1 -- 172.21.15.116:0/2614401371 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd002c810 con 0x7febdc0a96e0 2024-01-23T08:10:30.910 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febdaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febdaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febdaffd640 10 monclient: dump: 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febe27d0640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:30.911 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.910+0000 7febe27d0640 4 set_mon_vals no callback set 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 10 monclient: shutdown 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 1 -- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 msgr2=0x7febc40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 1 --2- 172.21.15.116:0/2614401371 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc0a96e0 0x7febc40047c0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7febd000c0e0 tx=0x7febc40057f0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe0d6d640 1 -- 172.21.15.116:0/2614401371 reap_dead start 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 1 -- 172.21.15.116:0/2614401371 shutdown_connections 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 1 -- 172.21.15.116:0/2614401371 >> 172.21.15.116:0/2614401371 conn(0x7febdc0b7bb0 msgr2=0x7febdc0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 1 -- 172.21.15.116:0/2614401371 shutdown_connections 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.911+0000 7febe27d0640 1 -- 172.21.15.116:0/2614401371 wait complete. 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 10 monclient: build_initial_monmap 2024-01-23T08:10:30.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 10 monclient: monmap: 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 1 librados: starting msgr at 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 1 librados: starting objecter 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 1 Processor -- start 2024-01-23T08:10:30.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 1 -- start start 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 1 librados: setting wanted keys 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 1 librados: calling monclient init 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.912+0000 7febe27d0640 10 monclient: init 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febdc0a96e0 0x7febdc0b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): picked mon.noname-a con 0x7febdc0a96e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:30.916 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febdc140220 0x7febdc142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): picked mon.noname-b con 0x7febdc140220 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc142890 0x7febdc1da8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): picked mon.noname-c con 0x7febdc142890 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc13ebc0 con 0x7febdc0a96e0 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc1d8340 con 0x7febdc140220 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc140020 con 0x7febdc142890 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:30.917 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.913+0000 7febe27d0640 10 monclient(hunting): authenticate will time out at 4638.271586s 2024-01-23T08:10:30.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.917+0000 7febe0d6d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc142890 0x7febdc1da8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:30.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.918+0000 7febe0d6d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc142890 0x7febdc1da8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48534/0 (socket says 172.21.15.116:48534) 2024-01-23T08:10:30.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.918+0000 7febe0d6d640 1 -- 172.21.15.116:0/2179214082 learned_addr learned my addr 172.21.15.116:0/2179214082 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:30.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.918+0000 7febe0d6d640 10 monclient(hunting): get_auth_request con 0x7febdc142890 auth_method 0 2024-01-23T08:10:30.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.918+0000 7febe0d6d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:30.918 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.918+0000 7febe0d6d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:30.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.918+0000 7febe0d6d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:30.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.919+0000 7febe0d6d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:30.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.919+0000 7febe0d6d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:30.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.919+0000 7febe0d6d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:30.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 10 monclient(hunting): handle_auth_done global_id 28472 payload 824 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 1 -- 172.21.15.116:0/2179214082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febdc140220 msgr2=0x7febdc142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febdc140220 0x7febdc142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 1 -- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febdc0a96e0 msgr2=0x7febdc0b7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febdc0a96e0 0x7febdc0b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 10 monclient: _finish_hunting 0 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 1 monclient: found mon.noname-c 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.941+0000 7febe0d6d640 1 -- 172.21.15.116:0/2179214082 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc1d73f0 con 0x7febdc142890 2024-01-23T08:10:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.952+0000 7febe0d6d640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc142890 0x7febdc1da8f0 secure :-1 s=READY pgs=3331 cs=0 l=1 rev1=1 crypto rx=0x7febdc06c2a0 tx=0x7febd400c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.952+0000 7febd8ff9640 10 client.?.objecter ms_handle_connect 0x7febdc142890 2024-01-23T08:10:30.952 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.952+0000 7febd8ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:30.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 1 -- 172.21.15.116:0/2179214082 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd40070d0 con 0x7febdc142890 2024-01-23T08:10:30.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:30.967 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: dump: 2024-01-23T08:10:30.967 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.967 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: _finish_auth 0 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: _check_auth_tickets 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 1 -- 172.21.15.116:0/2179214082 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4007250 con 0x7febdc142890 2024-01-23T08:10:30.968 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 1 -- 172.21.15.116:0/2179214082 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4007600 con 0x7febdc142890 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febd8ff9640 10 monclient: dump: 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:30.969 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febe27d0640 5 monclient: authenticate success, global_id 28472 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 monclient: _renew_subs 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc13ee30 con 0x7febdc142890 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.966+0000 7febda7fc640 4 set_mon_vals no callback set 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 client.28472.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 monclient: _renew_subs 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc142cf0 con 0x7febdc142890 2024-01-23T08:10:30.970 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 1 librados: init done 2024-01-23T08:10:30.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:30.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:30.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:30.971 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:30.967+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc142ee0 con 0x7febdc142890 2024-01-23T08:10:31.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.314+0000 7febd8ff9640 1 -- 172.21.15.116:0/2179214082 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7febd4007760 con 0x7febdc142890 2024-01-23T08:10:31.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.315+0000 7febd8ff9640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7febc806c8b0 0x7febc806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.315+0000 7febdbfff640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7febc806c8b0 0x7febc806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.315+0000 7febdbfff640 10 monclient: get_auth_request con 0x7febc806c8b0 auth_method 0 2024-01-23T08:10:31.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.315+0000 7febdbfff640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7febc806c8b0 0x7febc806ed70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7febcc009a40 tx=0x7febcc009500 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:31.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.315+0000 7febd8ff9640 10 client.28472.objecter ms_handle_connect 0x7febc806c8b0 2024-01-23T08:10:31.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 1 -- 172.21.15.116:0/2179214082 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7febd40581a0 con 0x7febdc142890 2024-01-23T08:10:31.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 10 client.28472.objecter ms_dispatch 0x7febdc000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:31.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 3 client.28472.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:31.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 3 client.28472.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:31.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 20 client.28472.objecter dump_active .. 0 homeless 2024-01-23T08:10:31.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 1 -- 172.21.15.116:0/2179214082 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7febd4053de0 con 0x7febdc142890 2024-01-23T08:10:31.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:31.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.333+0000 7febd8ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:31.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.542+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7febdc067d70 con 0x7febc806c8b0 2024-01-23T08:10:31.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.542+0000 7febd8ff9640 1 -- 172.21.15.116:0/2179214082 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7febdc067d70 con 0x7febc806c8b0 2024-01-23T08:10:31.544 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 3 to deep-scrub 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 10 librados: watch_flush enter 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 10 librados: watch_flush exit 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 20 client.28472.objecter shutdown clearing up homeless session... 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 10 client.28472.objecter successfully canceled tick 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7febc806c8b0 msgr2=0x7febc806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7febc806c8b0 0x7febc806ed70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7febcc009a40 tx=0x7febcc009500 comp rx=0 tx=0).stop 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 10 monclient: shutdown 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc142890 msgr2=0x7febdc1da8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc142890 0x7febdc1da8f0 secure :-1 s=READY pgs=3331 cs=0 l=1 rev1=1 crypto rx=0x7febdc06c2a0 tx=0x7febd400c8e0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.544+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 shutdown_connections 2024-01-23T08:10:31.546 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7febc806c8b0 0x7febc806ed70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7febdc142890 0x7febdc1da8f0 unknown :-1 s=CLOSED pgs=3331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7febdc140220 0x7febdc142350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 --2- 172.21.15.116:0/2179214082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7febdc0a96e0 0x7febdc0b7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 >> 172.21.15.116:0/2179214082 conn(0x7febdc0b7bb0 msgr2=0x7febdc138540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:31.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 shutdown_connections 2024-01-23T08:10:31.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 -- 172.21.15.116:0/2179214082 wait complete. 2024-01-23T08:10:31.547 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.545+0000 7febe27d0640 1 librados: shutdown 2024-01-23T08:10:31.558 INFO:tasks.ceph:Scrubbing osd.4 2024-01-23T08:10:31.558 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:31.581 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:19.918 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:31.582 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:19.919 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:31.590 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:19.927 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:31.664 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.664+0000 7fb14c3e1640 10 monclient: get_monmap_and_config 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.664+0000 7fb14c3e1640 10 monclient: build_initial_monmap 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.664+0000 7fb14c3e1640 10 monclient: monmap: 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:31.666055+0000 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:31.666055+0000 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:31.665 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:31.666 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:31.666 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.665+0000 7fb14c3e1640 1 Processor -- start 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.665+0000 7fb14c3e1640 1 -- start start 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.665+0000 7fb14c3e1640 10 monclient: init 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient: _add_conns ranks=[2,4,3,1,0] 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440b2820 0x7fb14413f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): picked mon.noname-b con 0x7fb1440b2820 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb1440a9c70 0x7fb14413f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): picked mon.noname-c con 0x7fb1440a9c70 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb1440b1580 0x7fb144142080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.667 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): picked mon.noname-a con 0x7fb1440b1580 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440b5300 con 0x7fb1440b1580 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440b2c00 con 0x7fb1440a9c70 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b33d0 con 0x7fb1440b2820 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:31.668 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.666+0000 7fb14c3e1640 10 monclient(hunting): authenticate will time out at 4639.024462s 2024-01-23T08:10:31.669 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.669+0000 7fb14a97e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb1440b1580 0x7fb144142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.671+0000 7fb14a97e640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7fb1440b1580 0x7fb144142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33880/0 (socket says 172.21.15.116:33880) 2024-01-23T08:10:31.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.671+0000 7fb14a97e640 1 -- 172.21.15.116:0/3858021278 learned_addr learned my addr 172.21.15.116:0/3858021278 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:31.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.671+0000 7fb14a97e640 10 monclient(hunting): get_auth_request con 0x7fb1440b1580 auth_method 0 2024-01-23T08:10:31.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.671+0000 7fb14a97e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:31.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.671+0000 7fb14a97e640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:31.671 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.671+0000 7fb14a97e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:31.672 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.672+0000 7fb14997c640 1 --2- 172.21.15.116:0/3858021278 >> v2:172.21.15.173:3300/0 conn(0x7fb1440a9c70 0x7fb14413f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.673+0000 7fb14a97e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:31.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.673+0000 7fb14a97e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:31.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.673+0000 7fb14a97e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:31.673 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.673+0000 7fb14a17d640 1 --2- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440b2820 0x7fb14413f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 10 monclient(hunting): handle_auth_done global_id 16560 payload 274 2024-01-23T08:10:31.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 1 -- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440b2820 msgr2=0x7fb14413f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:31.675 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 1 --2- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440b2820 0x7fb14413f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 1 -- 172.21.15.116:0/3858021278 >> v2:172.21.15.173:3300/0 conn(0x7fb1440a9c70 msgr2=0x7fb14413f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:31.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 1 --2- 172.21.15.116:0/3858021278 >> v2:172.21.15.173:3300/0 conn(0x7fb1440a9c70 0x7fb14413f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 10 monclient: _finish_hunting 0 2024-01-23T08:10:31.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 1 monclient: found mon.noname-a 2024-01-23T08:10:31.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:31.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:31.676 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.675+0000 7fb14a97e640 1 -- 172.21.15.116:0/3858021278 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440b2eb0 con 0x7fb1440b1580 2024-01-23T08:10:31.688 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.688+0000 7fb14a97e640 1 --2- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 0x7fb144142080 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7fb144067150 tx=0x7fb13c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cf5750b3a0c81c server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 1 -- 172.21.15.116:0/3858021278 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c02c9e0 con 0x7fb1440b1580 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: dump: 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.693 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: _finish_auth 0 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: _check_auth_tickets 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 5 monclient: authenticate success, global_id 16560 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 1 -- 172.21.15.116:0/3858021278 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c02cb40 con 0x7fb1440b1580 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:31.694 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 4 set_mon_vals no callback set 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 1 -- 172.21.15.116:0/3858021278 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c0343f0 con 0x7fb1440b1580 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14917b640 10 monclient: dump: 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:31.695 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:31.696 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:31.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 10 monclient: shutdown 2024-01-23T08:10:31.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:31.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 1 -- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 msgr2=0x7fb144142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.693+0000 7fb14c3e1640 1 --2- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 0x7fb144142080 secure :-1 s=READY pgs=3246 cs=0 l=1 rev1=1 crypto rx=0x7fb144067150 tx=0x7fb13c02be40 comp rx=0 tx=0).stop 2024-01-23T08:10:31.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 1 -- 172.21.15.116:0/3858021278 shutdown_connections 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 1 --2- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 0x7fb144142080 unknown :-1 s=CLOSED pgs=3246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 1 --2- 172.21.15.116:0/3858021278 >> v2:172.21.15.173:3300/0 conn(0x7fb1440a9c70 0x7fb14413f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 1 --2- 172.21.15.116:0/3858021278 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440b2820 0x7fb14413f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 1 -- 172.21.15.116:0/3858021278 >> 172.21.15.116:0/3858021278 conn(0x7fb14406ccd0 msgr2=0x7fb144066450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 1 -- 172.21.15.116:0/3858021278 shutdown_connections 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 1 -- 172.21.15.116:0/3858021278 wait complete. 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 10 monclient: build_initial_monmap 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.694+0000 7fb14c3e1640 10 monclient: monmap: 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:31.698 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.695+0000 7fb14c3e1640 1 librados: starting msgr at 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.695+0000 7fb14c3e1640 1 librados: starting objecter 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.695+0000 7fb14c3e1640 1 Processor -- start 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.695+0000 7fb14c3e1640 1 -- start start 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.695+0000 7fb14c3e1640 1 librados: setting wanted keys 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.695+0000 7fb14c3e1640 1 librados: calling monclient init 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.695+0000 7fb14c3e1640 10 monclient: init 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T08:10:31.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440a9c70 0x7fb144144fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): picked mon.noname-c con 0x7fb1440a9c70 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 0x7fb1441d7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): picked mon.noname-a con 0x7fb1440b1580 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1440b2820 0x7fb1441d7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): picked mon.noname-b con 0x7fb1440b2820 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440abd30 con 0x7fb1440b1580 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1441459c0 con 0x7fb1440b2820 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb144145600 con 0x7fb1440a9c70 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:31.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.696+0000 7fb14c3e1640 10 monclient(hunting): authenticate will time out at 4639.054436s 2024-01-23T08:10:31.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.703+0000 7fb14a17d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440a9c70 0x7fb144144fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.704+0000 7fb14997c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 0x7fb1441d7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.706+0000 7fb14a17d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440a9c70 0x7fb144144fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48556/0 (socket says 172.21.15.116:48556) 2024-01-23T08:10:31.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.706+0000 7fb14a17d640 1 -- 172.21.15.116:0/1522133626 learned_addr learned my addr 172.21.15.116:0/1522133626 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:31.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.706+0000 7fb14a17d640 10 monclient(hunting): get_auth_request con 0x7fb1440a9c70 auth_method 0 2024-01-23T08:10:31.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.706+0000 7fb14a17d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:31.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.706+0000 7fb14a17d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:31.706 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.706+0000 7fb14a17d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:31.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.707+0000 7fb14997c640 10 monclient(hunting): get_auth_request con 0x7fb1440b1580 auth_method 0 2024-01-23T08:10:31.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.707+0000 7fb14997c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:31.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.707+0000 7fb14997c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:31.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.707+0000 7fb14997c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:31.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.709+0000 7fb14a17d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:31.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.709+0000 7fb14a17d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:31.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.709+0000 7fb14a17d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:31.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 10 monclient(hunting): handle_auth_done global_id 28475 payload 824 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 1 -- 172.21.15.116:0/1522133626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1440b2820 msgr2=0x7fb1441d7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1440b2820 0x7fb1441d7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 1 -- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 msgr2=0x7fb1441d7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb1440b1580 0x7fb1441d7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 10 monclient: _finish_hunting 0 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 1 monclient: found mon.noname-c 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T08:10:31.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.714+0000 7fb14a17d640 1 -- 172.21.15.116:0/1522133626 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c009b30 con 0x7fb1440a9c70 2024-01-23T08:10:31.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.728+0000 7fb14a17d640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440a9c70 0x7fb144144fd0 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c7f0 tx=0x7fb14000ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:31.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.728+0000 7fb13affd640 10 client.?.objecter ms_handle_connect 0x7fb1440a9c70 2024-01-23T08:10:31.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.728+0000 7fb13affd640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:31.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140004220 con 0x7fb1440a9c70 2024-01-23T08:10:31.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:31.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:31.775 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: dump: 2024-01-23T08:10:31.775 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:31.775 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:31.775 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: _finish_auth 0 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140004380 con 0x7fb1440a9c70 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 5 monclient: authenticate success, global_id 28475 2024-01-23T08:10:31.776 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 10 monclient: _renew_subs 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb144146330 con 0x7fb1440a9c70 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140007840 con 0x7fb1440a9c70 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb13affd640 10 monclient: dump: 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:31.777 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 10 client.28475.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 10 monclient: _renew_subs 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb144141b30 con 0x7fb1440a9c70 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14c3e1640 1 librados: init done 2024-01-23T08:10:31.778 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.774+0000 7fb14897a640 4 set_mon_vals no callback set 2024-01-23T08:10:31.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.775+0000 7fb14c3e1640 10 client.28475.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:31.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.775+0000 7fb14c3e1640 15 client.28475.objecter _session_command_op_assign -1 1 2024-01-23T08:10:31.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.775+0000 7fb14c3e1640 20 client.28475.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:31.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.775+0000 7fb14c3e1640 10 client.28475.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:31.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.775+0000 7fb14c3e1640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:31.779 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.775+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb144145820 con 0x7fb1440a9c70 2024-01-23T08:10:31.792 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:20.172 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:31.793 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:20.173 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:31.806 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:20.185 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:31.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.806+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb140007bb0 con 0x7fb1440a9c70 2024-01-23T08:10:31.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.807+0000 7fb13affd640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb12806c8b0 0x7fb12806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.807+0000 7fb14997c640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb12806c8b0 0x7fb12806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.807+0000 7fb14997c640 10 monclient: get_auth_request con 0x7fb12806c8b0 auth_method 0 2024-01-23T08:10:31.807 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.807+0000 7fb13affd640 10 client.28475.objecter ms_handle_connect 0x7fb12806c8b0 2024-01-23T08:10:31.808 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.807+0000 7fb14997c640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb12806c8b0 0x7fb12806ed70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb14413f860 tx=0x7fb134008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fb140058d10 con 0x7fb1440a9c70 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 10 client.28475.objecter ms_dispatch 0x7fb144000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 3 client.28475.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 3 client.28475.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 10 client.28475.objecter checking command 1 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7fb128074630 0x7fb128076ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 20 client.28475.objecter _get_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.817 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 20 client.28475.objecter put_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 15 client.28475.objecter _session_command_op_remove -1 1 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 20 client.28475.objecter _get_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 20 client.28475.objecter get_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 15 client.28475.objecter _session_command_op_assign 4 1 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 20 client.28475.objecter put_session s=0x7fb128073f60 osd=4 4 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 10 client.28475.objecter _send_command 1 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 --> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1280771a0 con 0x7fb128074630 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 20 client.28475.objecter dump_active .. 0 homeless 2024-01-23T08:10:31.818 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14000a3b0 con 0x7fb1440a9c70 2024-01-23T08:10:31.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.816+0000 7fb13affd640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:31.819 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.817+0000 7fb14a97e640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7fb128074630 0x7fb128076ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:31.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.817+0000 7fb14a97e640 10 monclient: get_auth_request con 0x7fb128074630 auth_method 0 2024-01-23T08:10:31.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.820+0000 7fb13affd640 10 client.28475.objecter ms_handle_connect 0x7fb128074630 2024-01-23T08:10:31.820 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.820+0000 7fb14a97e640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7fb128074630 0x7fb128076ad0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:31.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.845+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== osd.4 v2:172.21.15.173:6806/3961996474 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb1280771a0 con 0x7fb128074630 2024-01-23T08:10:31.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.845+0000 7fb13affd640 10 client.28475.objecter ms_dispatch 0x7fb144000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:31.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.845+0000 7fb13affd640 10 client.28475.objecter _finish_command 1 = system:0 2024-01-23T08:10:31.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.845+0000 7fb13affd640 20 client.28475.objecter put_session s=0x7fb128073f60 osd=4 4 2024-01-23T08:10:31.845 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.845+0000 7fb13affd640 15 client.28475.objecter _session_command_op_remove 4 1 2024-01-23T08:10:31.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 10 client.28475.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:31.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 15 client.28475.objecter _session_command_op_assign -1 2 2024-01-23T08:10:31.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 20 client.28475.objecter _get_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.861 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 20 client.28475.objecter put_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 20 client.28475.objecter _get_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 15 client.28475.objecter _session_command_op_remove -1 2 2024-01-23T08:10:31.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 20 client.28475.objecter get_session s=0x7fb128073f60 osd=4 3 2024-01-23T08:10:31.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 15 client.28475.objecter _session_command_op_assign 4 2 2024-01-23T08:10:31.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 20 client.28475.objecter put_session s=0x7fb128073f60 osd=4 4 2024-01-23T08:10:31.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 10 client.28475.objecter _send_command 2 2024-01-23T08:10:31.862 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.861+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 --> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1440aa100 con 0x7fb128074630 2024-01-23T08:10:31.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.874+0000 7fb13affd640 1 -- 172.21.15.116:0/1522133626 <== osd.4 v2:172.21.15.173:6806/3961996474 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb1440aa100 con 0x7fb128074630 2024-01-23T08:10:31.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.874+0000 7fb13affd640 10 client.28475.objecter ms_dispatch 0x7fb144000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:31.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.874+0000 7fb13affd640 10 client.28475.objecter _finish_command 2 = system:0 2024-01-23T08:10:31.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.874+0000 7fb13affd640 20 client.28475.objecter put_session s=0x7fb128073f60 osd=4 4 2024-01-23T08:10:31.874 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.874+0000 7fb13affd640 15 client.28475.objecter _session_command_op_remove 4 2 2024-01-23T08:10:31.875 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:31.875 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:31.875 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:31.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.874+0000 7fb14c3e1640 10 librados: watch_flush enter 2024-01-23T08:10:31.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.874+0000 7fb14c3e1640 10 librados: watch_flush exit 2024-01-23T08:10:31.876 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 10 client.28475.objecter close_session for osd.4 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7fb128074630 msgr2=0x7fb128076ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.173:6806/3961996474,v1:172.21.15.173:6807/3961996474] conn(0x7fb128074630 0x7fb128076ad0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 20 client.28475.objecter put_session s=0x7fb128073f60 osd=4 1 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 20 client.28475.objecter shutdown clearing up homeless session... 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 10 client.28475.objecter successfully canceled tick 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb12806c8b0 msgr2=0x7fb12806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb12806c8b0 0x7fb12806ed70 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb14413f860 tx=0x7fb134008040 comp rx=0 tx=0).stop 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 10 monclient: shutdown 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440a9c70 msgr2=0x7fb144144fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 --2- 172.21.15.116:0/1522133626 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb1440a9c70 0x7fb144144fd0 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7fb14000c7f0 tx=0x7fb14000ccb0 comp rx=0 tx=0).stop 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14a97e640 1 -- 172.21.15.116:0/1522133626 reap_dead start 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 shutdown_connections 2024-01-23T08:10:31.877 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 >> 172.21.15.116:0/1522133626 conn(0x7fb14406ccd0 msgr2=0x7fb1440b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:31.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 shutdown_connections 2024-01-23T08:10:31.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 -- 172.21.15.116:0/1522133626 wait complete. 2024-01-23T08:10:31.878 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.875+0000 7fb14c3e1640 1 librados: shutdown 2024-01-23T08:10:31.890 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-23T08:10:31.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.991+0000 7f4713267640 10 monclient: get_monmap_and_config 2024-01-23T08:10:31.991 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.991+0000 7f4713267640 10 monclient: build_initial_monmap 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.991+0000 7f4713267640 10 monclient: monmap: 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:31.992859+0000 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:31.992859+0000 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:31.992 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:31.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.992+0000 7f4713267640 1 Processor -- start 2024-01-23T08:10:31.993 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.992+0000 7f4713267640 1 -- start start 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.992+0000 7f4713267640 10 monclient: init 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.992+0000 7f4713267640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 10 monclient: _add_conns ranks=[1,3,0,2,4] 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f470c0a96e0 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f470c0a9ac0 0x7f470c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 10 monclient(hunting): picked mon.noname-a con 0x7f470c0a9ac0 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f470c0b25b0 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c0aa880 con 0x7f470c0b25b0 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c0aaad0 con 0x7f470c0a96e0 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c0aadb0 con 0x7f470c0a9ac0 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:31.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.993+0000 7f4713267640 10 monclient(hunting): authenticate will time out at 4639.351296s 2024-01-23T08:10:31.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.995+0000 7f4711003640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f470c0a96e0 0x7f470c1427e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42168/0 (socket says 172.21.15.116:42168) 2024-01-23T08:10:31.995 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:31.995+0000 7f4711003640 1 -- 172.21.15.116:0/1217657121 learned_addr learned my addr 172.21.15.116:0/1217657121 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:32.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.006+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066180295 0 0) 0x7f470c0aaad0 con 0x7f470c0a96e0 2024-01-23T08:10:32.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.006+0000 7f4703fff640 10 monclient(hunting): _negotiate 2024-01-23T08:10:32.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.006+0000 7f4703fff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.006+0000 7f4703fff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.006+0000 7f4703fff640 10 monclient(hunting): my global_id is 20962 2024-01-23T08:10:32.006 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.006+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f8003520 con 0x7f470c0a96e0 2024-01-23T08:10:32.008 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.008+0000 7f4710802640 1 --2- 172.21.15.116:0/1217657121 >> v2:172.21.15.116:3300/0 conn(0x7f470c0a9ac0 0x7f470c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.012+0000 7f4710802640 10 monclient(hunting): get_auth_request con 0x7f470c0a9ac0 auth_method 0 2024-01-23T08:10:32.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.012+0000 7f4710802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.012+0000 7f4710802640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.012+0000 7f4710802640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.012+0000 7f4710802640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.012+0000 7f4710802640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.013 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.012+0000 7f4710802640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 <== mon.1 v1:172.21.15.173:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2470124548 0 0) 0x7f46f8003520 con 0x7f470c0a96e0 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 >> v2:172.21.15.116:3300/0 conn(0x7f470c0a9ac0 msgr2=0x7f470c13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 --2- 172.21.15.116:0/1217657121 >> v2:172.21.15.116:3300/0 conn(0x7f470c0a9ac0 0x7f470c13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 >> v1:172.21.15.116:6789/0 conn(0x7f470c0b25b0 legacy=0x7f470c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: _finish_hunting 0 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 monclient: found mon.noname-c-legacy 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: _send_mon_message to mon.noname-c-legacy at v1:172.21.15.173:6789/0 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 --> v1:172.21.15.173:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0ab090 con 0x7f470c0a96e0 2024-01-23T08:10:32.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: _finish_auth 0 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 <== mon.1 v1:172.21.15.173:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4041568432 0 0) 0x7f4708001670 con 0x7f470c0a96e0 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: got monmap 1 from mon.noname-c-legacy (according to old e1) 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: dump: 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.016 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.017 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.017 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 monclient: mon.b has (v2) addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] but i'm connected to v1:172.21.15.173:6789/0, reconnecting 2024-01-23T08:10:32.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:32.017 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 >> v1:172.21.15.173:6789/0 conn(0x7f470c0a96e0 legacy=0x7f470c1427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f80039c0 0x7f46f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): picked mon.a con 0x7f46f80039c0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46f80047c0 0x7f46f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): picked mon.b con 0x7f46f80047c0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f46f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): picked mon.c con 0x7f46f8005180 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c0aadb0 con 0x7f46f80039c0 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f800c080 con 0x7f46f80047c0 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f800c240 con 0x7f46f8005180 2024-01-23T08:10:32.018 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:32.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.014+0000 7f4703fff640 10 monclient(hunting): _finish_auth 0 2024-01-23T08:10:32.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.016+0000 7f4711804640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f46f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.019+0000 7f4711804640 10 monclient(hunting): get_auth_request con 0x7f46f8005180 auth_method 0 2024-01-23T08:10:32.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.019+0000 7f4711804640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.019+0000 7f4711804640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.019 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.019+0000 7f4711804640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T08:10:32.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.021+0000 7f4711003640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f80039c0 0x7f46f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.021 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.022+0000 7f4711804640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.022+0000 7f4711804640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.022+0000 7f4711804640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-01-23T08:10:32.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.023+0000 7f4711003640 10 monclient(hunting): get_auth_request con 0x7f46f80039c0 auth_method 0 2024-01-23T08:10:32.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.023+0000 7f4711003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.023+0000 7f4711003640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.022 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.023+0000 7f4711003640 10 monclient(hunting): _init_auth already have auth, reseting 2024-01-23T08:10:32.023 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.023+0000 7f4710802640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46f80047c0 0x7f46f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 10 monclient(hunting): handle_auth_done global_id 20962 payload 293 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 1 -- 172.21.15.116:0/1217657121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46f80047c0 msgr2=0x7f46f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46f80047c0 0x7f46f8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 1 -- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f80039c0 msgr2=0x7f46f8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f46f80039c0 0x7f46f8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 10 monclient: _finish_hunting 0 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 1 monclient: found mon.c 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 1 -- 172.21.15.116:0/1217657121 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8003520 con 0x7f46f8005180 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 10 monclient: _finish_auth 0 2024-01-23T08:10:32.025 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 10 monclient: _check_auth_tickets 2024-01-23T08:10:32.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4711804640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:32.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4713267640 5 monclient: authenticate success, global_id 20962 2024-01-23T08:10:32.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.024+0000 7f4713267640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:32.026 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.025+0000 7f4711804640 1 -- 172.21.15.116:0/1217657121 reap_dead start 2024-01-23T08:10:32.029 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.029+0000 7f4711804640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f46f800b980 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f4704001e50 tx=0x7f46f80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0420928bdc92131 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704003b70 con 0x7f46f8005180 2024-01-23T08:10:32.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:32.036 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 10 monclient: dump: 2024-01-23T08:10:32.037 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.037 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.037 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.037 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.037 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.037 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.037 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704003cf0 con 0x7f46f8005180 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 1 -- 172.21.15.116:0/1217657121 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704005310 con 0x7f46f8005180 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4713267640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4713267640 4 set_mon_vals no callback set 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.036+0000 7f4703fff640 10 monclient: dump: 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.038 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.039 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.039 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.039 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.039 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.039 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.039 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 10 monclient: shutdown 2024-01-23T08:10:32.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:32.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 1 -- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 msgr2=0x7f46f800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f46f800b980 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f4704001e50 tx=0x7f46f80057f0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 1 -- 172.21.15.116:0/1217657121 shutdown_connections 2024-01-23T08:10:32.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 1 --2- 172.21.15.116:0/1217657121 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f46f800b980 unknown :-1 s=CLOSED pgs=3333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.041 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 1 -- 172.21.15.116:0/1217657121 >> 172.21.15.116:0/1217657121 conn(0x7f470c0b7bb0 msgr2=0x7f470c0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 1 -- 172.21.15.116:0/1217657121 shutdown_connections 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.037+0000 7f4713267640 1 -- 172.21.15.116:0/1217657121 wait complete. 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 10 monclient: build_initial_monmap 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 10 monclient: monmap: 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:32.042 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 1 librados: starting msgr at 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 1 librados: starting objecter 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 1 Processor -- start 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 1 -- start start 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 1 librados: setting wanted keys 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 1 librados: calling monclient init 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.038+0000 7f4713267640 10 monclient: init 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f470c0b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): picked mon.noname-c con 0x7f46f8005180 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:32.043 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f470c1dad20 0x7f470c13c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): picked mon.noname-a con 0x7f470c1dad20 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c1db7b0 0x7f470c1d7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): picked mon.noname-b con 0x7f470c1db7b0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c1db390 con 0x7f470c1dad20 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c0ab640 con 0x7f470c1db7b0 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c0ac5f0 con 0x7f46f8005180 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.039+0000 7f4713267640 10 monclient(hunting): authenticate will time out at 4639.397354s 2024-01-23T08:10:32.044 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.041+0000 7f4711003640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f470c0b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.043+0000 7f4711003640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f470c0b0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3301/0 says I am v2:172.21.15.116:48568/0 (socket says 172.21.15.116:48568) 2024-01-23T08:10:32.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.043+0000 7f4711003640 1 -- 172.21.15.116:0/2033762163 learned_addr learned my addr 172.21.15.116:0/2033762163 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:32.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.043+0000 7f4711003640 10 monclient(hunting): get_auth_request con 0x7f46f8005180 auth_method 0 2024-01-23T08:10:32.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.043+0000 7f4711003640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.043+0000 7f4711003640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.045 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.043+0000 7f4711003640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.043+0000 7f4710802640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f470c1dad20 0x7f470c13c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.044+0000 7f4711003640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.044+0000 7f4711003640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.044+0000 7f4711003640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.046 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.046+0000 7f4711804640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c1db7b0 0x7f470c1d7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4710802640 10 monclient(hunting): get_auth_request con 0x7f470c1dad20 auth_method 0 2024-01-23T08:10:32.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4710802640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4710802640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.047 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4710802640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 10 monclient(hunting): handle_auth_done global_id 28478 payload 824 2024-01-23T08:10:32.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 1 -- 172.21.15.116:0/2033762163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c1db7b0 msgr2=0x7f470c1d7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c1db7b0 0x7f470c1d7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.048 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 1 -- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f470c1dad20 msgr2=0x7f470c13c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f470c1dad20 0x7f470c13c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 10 monclient: _finish_hunting 0 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 1 monclient: found mon.noname-c 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711003640 1 -- 172.21.15.116:0/2033762163 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c1dbc30 con 0x7f46f8005180 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711804640 10 monclient: get_auth_request con 0x7f470c1db7b0 auth_method 0 2024-01-23T08:10:32.049 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.047+0000 7f4711804640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c1db7b0 0x7f470c1d7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-23T08:10:32.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.052+0000 7f4711003640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f470c0b0ba0 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 crypto rx=0x7f470800e710 tx=0x7f470800ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.052+0000 7f4701ffb640 10 client.?.objecter ms_handle_connect 0x7f46f8005180 2024-01-23T08:10:32.052 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.052+0000 7f4701ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:32.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 1 -- 172.21.15.116:0/2033762163 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800c660 con 0x7f46f8005180 2024-01-23T08:10:32.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:32.058 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: dump: 2024-01-23T08:10:32.058 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.058 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.058 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 1 -- 172.21.15.116:0/2033762163 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470800c7e0 con 0x7f46f8005180 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4713267640 5 monclient: authenticate success, global_id 28478 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4713267640 10 monclient: _renew_subs 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4713267640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:32.059 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c1d7d60 con 0x7f46f8005180 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 1 -- 172.21.15.116:0/2033762163 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470800cb90 con 0x7f46f8005180 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f4701ffb640 10 monclient: dump: 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.060 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.061 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.057+0000 7f47037fe640 4 set_mon_vals no callback set 2024-01-23T08:10:32.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.058+0000 7f4713267640 10 client.28478.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:32.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.058+0000 7f4713267640 10 monclient: _renew_subs 2024-01-23T08:10:32.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.058+0000 7f4713267640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:32.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.058+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c136ea0 con 0x7f46f8005180 2024-01-23T08:10:32.061 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.058+0000 7f4713267640 1 librados: init done 2024-01-23T08:10:32.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.059+0000 7f4713267640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:32.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.059+0000 7f4713267640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:32.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.059+0000 7f4713267640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:32.062 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.059+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c1db100 con 0x7f46f8005180 2024-01-23T08:10:32.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.343+0000 7f4701ffb640 1 -- 172.21.15.116:0/2033762163 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f470801d460 con 0x7f46f8005180 2024-01-23T08:10:32.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.343+0000 7f4701ffb640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46f006c860 0x7f46f006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.344+0000 7f4710802640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46f006c860 0x7f46f006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.344+0000 7f4710802640 10 monclient: get_auth_request con 0x7f46f006c860 auth_method 0 2024-01-23T08:10:32.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.344+0000 7f4701ffb640 10 client.28478.objecter ms_handle_connect 0x7f46f006c860 2024-01-23T08:10:32.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.344+0000 7f4710802640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46f006c860 0x7f46f006ed20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f470c0a9ed0 tx=0x7f46fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.367 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 1 -- 172.21.15.116:0/2033762163 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f4708059580 con 0x7f46f8005180 2024-01-23T08:10:32.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 10 client.28478.objecter ms_dispatch 0x7f470c000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:32.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 3 client.28478.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:32.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 3 client.28478.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:32.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 20 client.28478.objecter dump_active .. 0 homeless 2024-01-23T08:10:32.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 1 -- 172.21.15.116:0/2033762163 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f47080551c0 con 0x7f46f8005180 2024-01-23T08:10:32.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:32.368 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.367+0000 7f4701ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:32.513 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:20.893 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:32.514 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:20.894 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:32.524 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:20.904 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:32.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.567+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f470c067d70 con 0x7f46f006c860 2024-01-23T08:10:32.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.567+0000 7f4701ffb640 1 -- 172.21.15.116:0/2033762163 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f470c067d70 con 0x7f46f006c860 2024-01-23T08:10:32.566 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 4 to deep-scrub 2024-01-23T08:10:32.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 10 librados: watch_flush enter 2024-01-23T08:10:32.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 10 librados: watch_flush exit 2024-01-23T08:10:32.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 20 client.28478.objecter shutdown clearing up homeless session... 2024-01-23T08:10:32.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 10 client.28478.objecter successfully canceled tick 2024-01-23T08:10:32.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46f006c860 msgr2=0x7f46f006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46f006c860 0x7f46f006ed20 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f470c0a9ed0 tx=0x7f46fc008040 comp rx=0 tx=0).stop 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 10 monclient: shutdown 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 msgr2=0x7f470c0b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f470c0b0ba0 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 crypto rx=0x7f470800e710 tx=0x7f470800ebd0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 shutdown_connections 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f46f006c860 0x7f46f006ed20 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f470c1db7b0 0x7f470c1d7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f470c1dad20 0x7f470c13c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 --2- 172.21.15.116:0/2033762163 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f46f8005180 0x7f470c0b0ba0 unknown :-1 s=CLOSED pgs=3334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 >> 172.21.15.116:0/2033762163 conn(0x7f470c0b7bb0 msgr2=0x7f470c13f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:32.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 shutdown_connections 2024-01-23T08:10:32.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 -- 172.21.15.116:0/2033762163 wait complete. 2024-01-23T08:10:32.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.569+0000 7f4713267640 1 librados: shutdown 2024-01-23T08:10:32.580 INFO:tasks.ceph:Scrubbing osd.5 2024-01-23T08:10:32.580 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.698+0000 7fb7a8312640 10 monclient: get_monmap_and_config 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.698+0000 7fb7a8312640 10 monclient: build_initial_monmap 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.698+0000 7fb7a8312640 10 monclient: monmap: 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:32.698526+0000 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:32.698526+0000 2024-01-23T08:10:32.697 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:32.698 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:32.698 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.699 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.699+0000 7fb7a8312640 1 Processor -- start 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.699+0000 7fb7a8312640 1 -- start start 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.699+0000 7fb7a8312640 10 monclient: init 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.699+0000 7fb7a8312640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.699+0000 7fb7a8312640 10 monclient: _add_conns ranks=[0,4,1,3,2] 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.699+0000 7fb7a8312640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb7a006bda0 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7fb7a006cf90 0x7fb7a006c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a006cf90 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fb7a013f850 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a00afae0 con 0x7fb7a006bda0 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a006d7c0 con 0x7fb7a013f850 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.700 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a013fcc0 con 0x7fb7a006cf90 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a8312640 10 monclient(hunting): authenticate will time out at 4640.057278s 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a60ae640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fb7a006bda0 0x7fb7a013f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51778/0 (socket says 172.21.15.116:51778) 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a60ae640 1 -- 172.21.15.116:0/1977229105 learned_addr learned my addr 172.21.15.116:0/1977229105 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a58ad640 1 --2- 172.21.15.116:0/1977229105 >> v2:172.21.15.173:3300/0 conn(0x7fb7a006cf90 0x7fb7a006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a58ad640 10 monclient(hunting): get_auth_request con 0x7fb7a006cf90 auth_method 0 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a58ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a58ad640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.701 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.700+0000 7fb7a58ad640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.702 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.701+0000 7fb7a58ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.701+0000 7fb7a58ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.701+0000 7fb7a58ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.702+0000 7fb7a50ac640 1 -- 172.21.15.116:0/1977229105 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861850380 0 0) 0x7fb7a00afae0 con 0x7fb7a006bda0 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.702+0000 7fb7a50ac640 10 monclient(hunting): _negotiate 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.702+0000 7fb7a50ac640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.702+0000 7fb7a50ac640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.702+0000 7fb7a50ac640 10 monclient(hunting): my global_id is 16575 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.702+0000 7fb7a50ac640 1 -- 172.21.15.116:0/1977229105 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb78c003520 con 0x7fb7a006bda0 2024-01-23T08:10:32.703 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 10 monclient(hunting): handle_auth_done global_id 20965 payload 274 2024-01-23T08:10:32.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 1 -- 172.21.15.116:0/1977229105 >> v1:172.21.15.173:6789/0 conn(0x7fb7a013f850 legacy=0x7fb7a0142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:32.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 1 -- 172.21.15.116:0/1977229105 >> v1:172.21.15.116:6789/0 conn(0x7fb7a006bda0 legacy=0x7fb7a013f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 10 monclient: _finish_hunting 0 2024-01-23T08:10:32.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 1 monclient: found mon.noname-c 2024-01-23T08:10:32.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:32.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T08:10:32.704 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.703+0000 7fb7a58ad640 1 -- 172.21.15.116:0/1977229105 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a00af770 con 0x7fb7a006cf90 2024-01-23T08:10:32.705 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.706+0000 7fb7a58ad640 1 --2- 172.21.15.116:0/1977229105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a006cf90 0x7fb7a006c180 secure :-1 s=READY pgs=5228 cs=0 l=1 rev1=1 crypto rx=0x7fb7900097a0 tx=0x7fb79002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=359b3c9e6ee55b9a server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.709+0000 7fb7a50ac640 1 -- 172.21.15.116:0/1977229105 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79002e070 con 0x7fb7a006cf90 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.709+0000 7fb7a50ac640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.709+0000 7fb7a50ac640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.709+0000 7fb7a50ac640 10 monclient: dump: 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.709 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 10 monclient: _finish_auth 0 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 10 monclient: _check_auth_tickets 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 1 -- 172.21.15.116:0/1977229105 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7900315a0 con 0x7fb7a006cf90 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 1 -- 172.21.15.116:0/1977229105 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790031930 con 0x7fb7a006cf90 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 5 monclient: authenticate success, global_id 20965 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 4 set_mon_vals no callback set 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a50ac640 10 monclient: dump: 2024-01-23T08:10:32.710 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.711 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 10 monclient: shutdown 2024-01-23T08:10:32.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:32.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 1 -- 172.21.15.116:0/1977229105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a006cf90 msgr2=0x7fb7a006c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 1 --2- 172.21.15.116:0/1977229105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a006cf90 0x7fb7a006c180 secure :-1 s=READY pgs=5228 cs=0 l=1 rev1=1 crypto rx=0x7fb7900097a0 tx=0x7fb79002b840 comp rx=0 tx=0).stop 2024-01-23T08:10:32.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 1 -- 172.21.15.116:0/1977229105 shutdown_connections 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 1 --2- 172.21.15.116:0/1977229105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a006cf90 0x7fb7a006c180 unknown :-1 s=CLOSED pgs=5228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 1 -- 172.21.15.116:0/1977229105 >> 172.21.15.116:0/1977229105 conn(0x7fb7a0067020 msgr2=0x7fb7a00b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 1 -- 172.21.15.116:0/1977229105 shutdown_connections 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.710+0000 7fb7a8312640 1 -- 172.21.15.116:0/1977229105 wait complete. 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 10 monclient: build_initial_monmap 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 10 monclient: monmap: 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:32.715 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 1 librados: starting msgr at 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 1 librados: starting objecter 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 1 Processor -- start 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 1 -- start start 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 1 librados: setting wanted keys 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 1 librados: calling monclient init 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.711+0000 7fb7a8312640 10 monclient: init 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a006bda0 0x7fb7a00b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.716 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): picked mon.noname-a con 0x7fb7a006bda0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7a013f850 0x7fb7a00b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): picked mon.noname-c con 0x7fb7a013f850 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0070240 0x7fb7a0132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): picked mon.noname-b con 0x7fb7a0070240 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00b4240 con 0x7fb7a006bda0 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a00b4500 con 0x7fb7a0070240 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a006fe90 con 0x7fb7a013f850 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a8312640 10 monclient(hunting): authenticate will time out at 4640.069752s 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.712+0000 7fb7a60ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a006bda0 0x7fb7a00b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.717 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a006bda0 0x7fb7a00b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33918/0 (socket says 172.21.15.116:33918) 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 1 -- 172.21.15.116:0/3013959276 learned_addr learned my addr 172.21.15.116:0/3013959276 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 10 monclient(hunting): get_auth_request con 0x7fb7a006bda0 auth_method 0 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a68af640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0070240 0x7fb7a0132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a68af640 10 monclient(hunting): get_auth_request con 0x7fb7a0070240 auth_method 0 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a68af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a68af640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a68af640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.713+0000 7fb7a60ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.714+0000 7fb7a68af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.714+0000 7fb7a68af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.714+0000 7fb7a68af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 10 monclient(hunting): handle_auth_done global_id 16578 payload 824 2024-01-23T08:10:32.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 1 -- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7a013f850 msgr2=0x7fb7a00b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fb7a013f850 0x7fb7a00b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 1 -- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0070240 msgr2=0x7fb7a0132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0070240 0x7fb7a0132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 10 monclient: _finish_hunting 0 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 1 monclient: found mon.noname-a 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a60ae640 1 -- 172.21.15.116:0/3013959276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790009400 con 0x7fb7a006bda0 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.716+0000 7fb7a68af640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7a0070240 0x7fb7a0132d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.718+0000 7fb7a60ae640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a006bda0 0x7fb7a00b3d00 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c460 tx=0x7fb79c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.718+0000 7fb796ffd640 10 client.?.objecter ms_handle_connect 0x7fb7a006bda0 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.718+0000 7fb796ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c005ce0 con 0x7fb7a006bda0 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb796ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb796ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb796ffd640 10 monclient: dump: 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.721 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb796ffd640 10 monclient: _finish_auth 0 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb796ffd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb796ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb7a8312640 5 monclient: authenticate success, global_id 16578 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb7a8312640 10 monclient: _renew_subs 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb7a8312640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.722 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.720+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a0133ad0 con 0x7fb7a006bda0 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 10 client.16578.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 10 monclient: _renew_subs 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a013acb0 con 0x7fb7a006bda0 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 1 librados: init done 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 10 client.16578.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 15 client.16578.objecter _session_command_op_assign -1 1 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 20 client.16578.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 10 client.16578.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.723 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.721+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7a014d900 con 0x7fb7a006bda0 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.742+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c005e40 con 0x7fb7a006bda0 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.742+0000 7fb796ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.742+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c007270 con 0x7fb7a006bda0 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.742+0000 7fb796ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.742+0000 7fb796ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.742+0000 7fb796ffd640 10 monclient: dump: 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.742 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.743 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.743 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.743 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.743 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.743 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.742+0000 7fb7a48ab640 4 set_mon_vals no callback set 2024-01-23T08:10:32.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.743+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fb79c007490 con 0x7fb7a006bda0 2024-01-23T08:10:32.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.743+0000 7fb796ffd640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb78406c890 0x7fb78406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.744+0000 7fb7a58ad640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb78406c890 0x7fb78406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.744+0000 7fb7a58ad640 10 monclient: get_auth_request con 0x7fb78406c890 auth_method 0 2024-01-23T08:10:32.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.744+0000 7fb796ffd640 10 client.16578.objecter ms_handle_connect 0x7fb78406c890 2024-01-23T08:10:32.744 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.744+0000 7fb7a58ad640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb78406c890 0x7fb78406ed50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb790036000 tx=0x7fb790030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.745 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fb79c058370 con 0x7fb7a006bda0 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 10 client.16578.objecter ms_dispatch 0x7fb7a0000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 3 client.16578.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 3 client.16578.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 10 client.16578.objecter checking command 1 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fb784074610 0x7fb784076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 20 client.16578.objecter _get_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 20 client.16578.objecter put_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 15 client.16578.objecter _session_command_op_remove -1 1 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 20 client.16578.objecter _get_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 20 client.16578.objecter get_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 15 client.16578.objecter _session_command_op_assign 5 1 2024-01-23T08:10:32.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 20 client.16578.objecter put_session s=0x7fb784073f40 osd=5 4 2024-01-23T08:10:32.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 10 client.16578.objecter _send_command 1 2024-01-23T08:10:32.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 --> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb784077180 con 0x7fb784074610 2024-01-23T08:10:32.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 20 client.16578.objecter dump_active .. 0 homeless 2024-01-23T08:10:32.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb79c0546b0 con 0x7fb7a006bda0 2024-01-23T08:10:32.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.746+0000 7fb796ffd640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:32.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.747+0000 7fb7a68af640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fb784074610 0x7fb784076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.747+0000 7fb7a68af640 10 monclient: get_auth_request con 0x7fb784074610 auth_method 0 2024-01-23T08:10:32.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.750+0000 7fb7a68af640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fb784074610 0x7fb784076ab0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.750+0000 7fb796ffd640 10 client.16578.objecter ms_handle_connect 0x7fb784074610 2024-01-23T08:10:32.772 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.773+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== osd.5 v2:172.21.15.173:6800/1137022367 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb784077180 con 0x7fb784074610 2024-01-23T08:10:32.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.773+0000 7fb796ffd640 10 client.16578.objecter ms_dispatch 0x7fb7a0000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:32.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.773+0000 7fb796ffd640 10 client.16578.objecter _finish_command 1 = system:0 2024-01-23T08:10:32.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.773+0000 7fb796ffd640 20 client.16578.objecter put_session s=0x7fb784073f40 osd=5 4 2024-01-23T08:10:32.773 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.773+0000 7fb796ffd640 15 client.16578.objecter _session_command_op_remove 5 1 2024-01-23T08:10:32.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 10 client.16578.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:32.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 15 client.16578.objecter _session_command_op_assign -1 2 2024-01-23T08:10:32.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 20 client.16578.objecter _get_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 20 client.16578.objecter put_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.785 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 20 client.16578.objecter _get_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 15 client.16578.objecter _session_command_op_remove -1 2 2024-01-23T08:10:32.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 20 client.16578.objecter get_session s=0x7fb784073f40 osd=5 3 2024-01-23T08:10:32.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 15 client.16578.objecter _session_command_op_assign 5 2 2024-01-23T08:10:32.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 20 client.16578.objecter put_session s=0x7fb784073f40 osd=5 4 2024-01-23T08:10:32.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 10 client.16578.objecter _send_command 2 2024-01-23T08:10:32.786 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.786+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 --> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7a0067d70 con 0x7fb784074610 2024-01-23T08:10:32.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb796ffd640 1 -- 172.21.15.116:0/3013959276 <== osd.5 v2:172.21.15.173:6800/1137022367 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb7a0067d70 con 0x7fb784074610 2024-01-23T08:10:32.798 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb796ffd640 10 client.16578.objecter ms_dispatch 0x7fb7a0000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:32.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb796ffd640 10 client.16578.objecter _finish_command 2 = system:0 2024-01-23T08:10:32.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb796ffd640 20 client.16578.objecter put_session s=0x7fb784073f40 osd=5 4 2024-01-23T08:10:32.799 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb796ffd640 15 client.16578.objecter _session_command_op_remove 5 2 2024-01-23T08:10:32.799 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:32.799 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:32.799 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:32.800 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 10 librados: watch_flush enter 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 10 librados: watch_flush exit 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 10 client.16578.objecter close_session for osd.5 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fb784074610 msgr2=0x7fb784076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.173:6800/1137022367,v1:172.21.15.173:6801/1137022367] conn(0x7fb784074610 0x7fb784076ab0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 20 client.16578.objecter put_session s=0x7fb784073f40 osd=5 1 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 20 client.16578.objecter shutdown clearing up homeless session... 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.799+0000 7fb7a8312640 10 client.16578.objecter successfully canceled tick 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb78406c890 msgr2=0x7fb78406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fb78406c890 0x7fb78406ed50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb790036000 tx=0x7fb790030000 comp rx=0 tx=0).stop 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 10 monclient: shutdown 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a006bda0 msgr2=0x7fb7a00b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.801 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 --2- 172.21.15.116:0/3013959276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7a006bda0 0x7fb7a00b3d00 secure :-1 s=READY pgs=3249 cs=0 l=1 rev1=1 crypto rx=0x7fb79c00c460 tx=0x7fb79c00c920 comp rx=0 tx=0).stop 2024-01-23T08:10:32.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a68af640 1 -- 172.21.15.116:0/3013959276 reap_dead start 2024-01-23T08:10:32.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 shutdown_connections 2024-01-23T08:10:32.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 >> 172.21.15.116:0/3013959276 conn(0x7fb7a0067020 msgr2=0x7fb7a00ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:32.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 shutdown_connections 2024-01-23T08:10:32.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 -- 172.21.15.116:0/3013959276 wait complete. 2024-01-23T08:10:32.802 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.800+0000 7fb7a8312640 1 librados: shutdown 2024-01-23T08:10:32.810 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-23T08:10:32.914 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.915+0000 7f299b4c9640 10 monclient: get_monmap_and_config 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.915+0000 7f299b4c9640 10 monclient: build_initial_monmap 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.915+0000 7f299b4c9640 10 monclient: monmap: 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:32.915825+0000 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:32.915825+0000 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.915 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:32.916 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:32.916 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:32.916 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:32.916 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:32.916 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.919 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.916+0000 7f299b4c9640 1 Processor -- start 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.916+0000 7f299b4c9640 1 -- start start 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.916+0000 7f299b4c9640 10 monclient: init 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient: _add_conns ranks=[1,3,2,0,4] 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f29940a96e0 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f299413faa0 0x7f29940b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient(hunting): picked mon.noname-a con 0x7f299413faa0 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2994145600 0x7f2994145a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.920 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient(hunting): picked mon.noname-b con 0x7f2994145600 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29940aac10 con 0x7f29940a96e0 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940a9e00 con 0x7f299413faa0 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940a9ac0 con 0x7f2994145600 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f299b4c9640 10 monclient(hunting): authenticate will time out at 4640.274424s 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f2998a64640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f299413faa0 0x7f29940b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f2999265640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f29940a96e0 0x7f299413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42188/0 (socket says 172.21.15.116:42188) 2024-01-23T08:10:32.921 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.917+0000 7f2999265640 1 -- 172.21.15.116:0/3624990242 learned_addr learned my addr 172.21.15.116:0/3624990242 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.918+0000 7f2998a64640 10 monclient(hunting): get_auth_request con 0x7f299413faa0 auth_method 0 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.918+0000 7f2998a64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.918+0000 7f2998a64640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.918+0000 7f2998a64640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.918+0000 7f2998a64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.918+0000 7f2998a64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.918+0000 7f2998a64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 10 monclient(hunting): handle_auth_done global_id 16581 payload 274 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 1 -- 172.21.15.116:0/3624990242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2994145600 msgr2=0x7f2994145a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 1 --2- 172.21.15.116:0/3624990242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2994145600 0x7f2994145a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.922 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 1 -- 172.21.15.116:0/3624990242 >> v1:172.21.15.173:6789/0 conn(0x7f29940a96e0 legacy=0x7f299413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 10 monclient: _finish_hunting 0 2024-01-23T08:10:32.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 1 monclient: found mon.noname-a 2024-01-23T08:10:32.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:32.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.920+0000 7f2998a64640 1 -- 172.21.15.116:0/3624990242 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940aae80 con 0x7f299413faa0 2024-01-23T08:10:32.923 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.921+0000 7f2998a64640 1 --2- 172.21.15.116:0/3624990242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299413faa0 0x7f29940b1850 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f2984009790 tx=0x7f298402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0e9a548934372f server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 1 -- 172.21.15.116:0/3624990242 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984031800 con 0x7f299413faa0 2024-01-23T08:10:32.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:32.924 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: dump: 2024-01-23T08:10:32.924 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.924 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.924 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: _finish_auth 0 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 1 -- 172.21.15.116:0/3624990242 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2984031960 con 0x7f299413faa0 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f299b4c9640 5 monclient: authenticate success, global_id 16581 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f299b4c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:32.925 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f299b4c9640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 1 -- 172.21.15.116:0/3624990242 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984031cf0 con 0x7f299413faa0 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f299b4c9640 4 set_mon_vals no callback set 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.925+0000 7f298bfff640 10 monclient: dump: 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.926 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 10 monclient: shutdown 2024-01-23T08:10:32.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 -- 172.21.15.116:0/3624990242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299413faa0 msgr2=0x7f29940b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 --2- 172.21.15.116:0/3624990242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299413faa0 0x7f29940b1850 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f2984009790 tx=0x7f298402b8a0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 -- 172.21.15.116:0/3624990242 shutdown_connections 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 --2- 172.21.15.116:0/3624990242 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2994145600 0x7f2994145a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 --2- 172.21.15.116:0/3624990242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f299413faa0 0x7f29940b1850 unknown :-1 s=CLOSED pgs=3250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 -- 172.21.15.116:0/3624990242 >> 172.21.15.116:0/3624990242 conn(0x7f29940b7bb0 msgr2=0x7f29940b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 -- 172.21.15.116:0/3624990242 shutdown_connections 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 1 -- 172.21.15.116:0/3624990242 wait complete. 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 10 monclient: build_initial_monmap 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.926+0000 7f299b4c9640 10 monclient: monmap: 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:32.930 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 librados: starting msgr at 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 librados: starting objecter 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 Processor -- start 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 -- start start 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 librados: setting wanted keys 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 librados: calling monclient init 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient: init 2024-01-23T08:10:32.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29940a96e0 0x7f2994144d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): picked mon.noname-b con 0x7f29940a96e0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299413faa0 0x7f299413a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): picked mon.noname-c con 0x7f299413faa0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2994145600 0x7f29941db490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): picked mon.noname-a con 0x7f2994145600 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:32.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29941db070 con 0x7f2994145600 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299413c740 con 0x7f29940a96e0 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29941dac90 con 0x7f299413faa0 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.927+0000 7f299b4c9640 10 monclient(hunting): authenticate will time out at 4640.285116s 2024-01-23T08:10:32.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999a66640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2994145600 0x7f29941db490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999a66640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2994145600 0x7f29941db490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33936/0 (socket says 172.21.15.116:33936) 2024-01-23T08:10:32.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999a66640 1 -- 172.21.15.116:0/915218105 learned_addr learned my addr 172.21.15.116:0/915218105 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:32.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999a66640 10 monclient(hunting): get_auth_request con 0x7f2994145600 auth_method 0 2024-01-23T08:10:32.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999a66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999a66640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999a66640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.934 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999265640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29940a96e0 0x7f2994144d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999265640 10 monclient(hunting): get_auth_request con 0x7f29940a96e0 auth_method 0 2024-01-23T08:10:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999265640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999265640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.928+0000 7f2999265640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.929+0000 7f2999a66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.935 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.929+0000 7f2999a66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.929+0000 7f2999a66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.929+0000 7f2999265640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.929+0000 7f2999265640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:32.936 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.929+0000 7f2999265640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:32.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 10 monclient(hunting): handle_auth_done global_id 16584 payload 824 2024-01-23T08:10:32.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 1 -- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299413faa0 msgr2=0x7f299413a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299413faa0 0x7f299413a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.939 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 1 -- 172.21.15.116:0/915218105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29940a96e0 msgr2=0x7f2994144d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:32.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29940a96e0 0x7f2994144d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:32.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 10 monclient: _finish_hunting 0 2024-01-23T08:10:32.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 1 monclient: found mon.noname-a 2024-01-23T08:10:32.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:32.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.940 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.931+0000 7f2999a66640 1 -- 172.21.15.116:0/915218105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840093a0 con 0x7f2994145600 2024-01-23T08:10:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.934+0000 7f2999a66640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2994145600 0x7f29941db490 secure :-1 s=READY pgs=3251 cs=0 l=1 rev1=1 crypto rx=0x7f298c00b9e0 tx=0x7f298c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.934+0000 7f2989ffb640 10 client.?.objecter ms_handle_connect 0x7f2994145600 2024-01-23T08:10:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.934+0000 7f2989ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f2989ffb640 1 -- 172.21.15.116:0/915218105 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00caa0 con 0x7f2994145600 2024-01-23T08:10:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f2989ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f2989ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:32.941 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f2989ffb640 10 monclient: dump: 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f2989ffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:32.942 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f2989ffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f2989ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 5 monclient: authenticate success, global_id 16584 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 10 monclient: _renew_subs 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299413b8c0 con 0x7f2994145600 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 10 client.16584.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 10 monclient: _renew_subs 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29941dbbb0 con 0x7f2994145600 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.936+0000 7f299b4c9640 1 librados: init done 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.937+0000 7f299b4c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:32.943 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.937+0000 7f299b4c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:32.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.937+0000 7f299b4c9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:32.944 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:32.937+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2994067d70 con 0x7f2994145600 2024-01-23T08:10:33.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.143+0000 7f2989ffb640 1 -- 172.21.15.116:0/915218105 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c009800 con 0x7f2994145600 2024-01-23T08:10:33.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.143+0000 7f2989ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:33.142 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.143+0000 7f298b7fe640 4 set_mon_vals no callback set 2024-01-23T08:10:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.214+0000 7f2989ffb640 1 -- 172.21.15.116:0/915218105 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00ce40 con 0x7f2994145600 2024-01-23T08:10:33.213 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.214+0000 7f2989ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.214+0000 7f2989ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.214+0000 7f2989ffb640 10 monclient: dump: 2024-01-23T08:10:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.214 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.215 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.214+0000 7f2989ffb640 1 -- 172.21.15.116:0/915218105 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f298c014480 con 0x7f2994145600 2024-01-23T08:10:33.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.215+0000 7f2989ffb640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f297806c860 0x7f297806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.215+0000 7f2999265640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f297806c860 0x7f297806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.215+0000 7f2999265640 10 monclient: get_auth_request con 0x7f297806c860 auth_method 0 2024-01-23T08:10:33.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.215+0000 7f2999265640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f297806c860 0x7f297806ed20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2990005880 tx=0x7f2990009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.217 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.215+0000 7f2989ffb640 10 client.16584.objecter ms_handle_connect 0x7f297806c860 2024-01-23T08:10:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 1 -- 172.21.15.116:0/915218105 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f298c058800 con 0x7f2994145600 2024-01-23T08:10:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 10 client.16584.objecter ms_dispatch 0x7f2994000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 3 client.16584.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 3 client.16584.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 20 client.16584.objecter dump_active .. 0 homeless 2024-01-23T08:10:33.226 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 1 -- 172.21.15.116:0/915218105 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f298c0585d0 con 0x7f2994145600 2024-01-23T08:10:33.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:33.227 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.227+0000 7f2989ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:33.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.399+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f29941db1b0 con 0x7f297806c860 2024-01-23T08:10:33.398 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.399+0000 7f2989ffb640 1 -- 172.21.15.116:0/915218105 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f29941db1b0 con 0x7f297806c860 2024-01-23T08:10:33.398 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 5 to deep-scrub 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 10 librados: watch_flush enter 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 10 librados: watch_flush exit 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 20 client.16584.objecter shutdown clearing up homeless session... 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 10 client.16584.objecter successfully canceled tick 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f297806c860 msgr2=0x7f297806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f297806c860 0x7f297806ed20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2990005880 tx=0x7f2990009040 comp rx=0 tx=0).stop 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 10 monclient: shutdown 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2994145600 msgr2=0x7f29941db490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2994145600 0x7f29941db490 secure :-1 s=READY pgs=3251 cs=0 l=1 rev1=1 crypto rx=0x7f298c00b9e0 tx=0x7f298c00bea0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 shutdown_connections 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f297806c860 0x7f297806ed20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2994145600 0x7f29941db490 unknown :-1 s=CLOSED pgs=3251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f299413faa0 0x7f299413a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 --2- 172.21.15.116:0/915218105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29940a96e0 0x7f2994144d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 >> 172.21.15.116:0/915218105 conn(0x7f29940b7bb0 msgr2=0x7f2994073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 shutdown_connections 2024-01-23T08:10:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 -- 172.21.15.116:0/915218105 wait complete. 2024-01-23T08:10:33.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.401+0000 7f299b4c9640 1 librados: shutdown 2024-01-23T08:10:33.412 INFO:tasks.ceph:Scrubbing osd.6 2024-01-23T08:10:33.412 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:33.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.515+0000 7f9a3d1c9640 10 monclient: get_monmap_and_config 2024-01-23T08:10:33.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.515+0000 7f9a3d1c9640 10 monclient: build_initial_monmap 2024-01-23T08:10:33.515 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.515+0000 7f9a3d1c9640 10 monclient: monmap: 2024-01-23T08:10:33.515 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:33.515 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:33.515759+0000 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:33.515759+0000 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 1 Processor -- start 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 1 -- start start 2024-01-23T08:10:33.516 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient: init 2024-01-23T08:10:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient: _add_conns ranks=[0,1,3,2,4] 2024-01-23T08:10:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9a38142240 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f9a3813f9a0 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f9a38142620 0x7f9a380b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient(hunting): picked mon.noname-a con 0x7f9a38142620 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:33.518 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a38142c10 con 0x7f9a38142240 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a380aa880 con 0x7f9a3813f9a0 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a380b3200 con 0x7f9a38142620 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.516+0000 7f9a3d1c9640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.517+0000 7f9a3d1c9640 10 monclient(hunting): authenticate will time out at 4640.874204s 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.517+0000 7f9a36d9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f9a38142240 0x7f9a3813f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51784/0 (socket says 172.21.15.116:51784) 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.517+0000 7f9a36d9d640 1 -- 172.21.15.116:0/1399025209 learned_addr learned my addr 172.21.15.116:0/1399025209 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.517+0000 7f9a3759e640 1 --2- 172.21.15.116:0/1399025209 >> v2:172.21.15.116:3300/0 conn(0x7f9a38142620 0x7f9a380b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.518+0000 7f9a3759e640 10 monclient(hunting): get_auth_request con 0x7f9a38142620 auth_method 0 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.518+0000 7f9a3759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.518+0000 7f9a3759e640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.518+0000 7f9a3759e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a36d9d640 1 -- 172.21.15.116:0/1399025209 >> v1:172.21.15.116:6789/0 conn(0x7f9a38142240 legacy=0x7f9a3813f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-01-23T08:10:33.519 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a36d9d640 1 -- 172.21.15.116:0/1399025209 >> v1:172.21.15.116:6789/0 conn(0x7f9a38142240 legacy=0x7f9a3813f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a36d9d640 1 --1- 172.21.15.116:0/1399025209 >> v1:172.21.15.116:6789/0 conn(0x7f9a38142240 0x7f9a3813f290 :-1 s=OPENED pgs=3252 cs=1 l=1).handle_message read tag failed 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a36d9d640 1 --1- 172.21.15.116:0/1399025209 >> v1:172.21.15.116:6789/0 conn(0x7f9a38142240 0x7f9a3813f290 :-1 s=OPENED pgs=3252 cs=1 l=1).fault on lossy channel, failing 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a3659c640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.116:6789/0 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a3759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a3759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.519+0000 7f9a3759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.520+0000 7f9a3659c640 1 -- 172.21.15.116:0/1399025209 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676067936 0 0) 0x7f9a380aa880 con 0x7f9a3813f9a0 2024-01-23T08:10:33.520 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.520+0000 7f9a3659c640 10 monclient(hunting): _negotiate 2024-01-23T08:10:33.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.520+0000 7f9a3659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:33.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.520+0000 7f9a3659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:33.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.520+0000 7f9a3659c640 10 monclient(hunting): my global_id is 20977 2024-01-23T08:10:33.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.520+0000 7f9a3659c640 1 -- 172.21.15.116:0/1399025209 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a24003520 con 0x7f9a3813f9a0 2024-01-23T08:10:33.521 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 10 monclient(hunting): handle_auth_done global_id 16587 payload 274 2024-01-23T08:10:33.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 1 -- 172.21.15.116:0/1399025209 >> v1:172.21.15.173:6789/0 conn(0x7f9a3813f9a0 legacy=0x7f9a380b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 1 -- 172.21.15.116:0/1399025209 >> v1:172.21.15.116:6789/0 conn(0x7f9a38142240 legacy=0x7f9a3813f290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-01-23T08:10:33.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 10 monclient: _finish_hunting 0 2024-01-23T08:10:33.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 1 monclient: found mon.noname-a 2024-01-23T08:10:33.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:33.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.522 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.523+0000 7f9a3759e640 1 -- 172.21.15.116:0/1399025209 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380aaaf0 con 0x7f9a38142620 2024-01-23T08:10:33.524 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.525+0000 7f9a3759e640 1 --2- 172.21.15.116:0/1399025209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142620 0x7f9a380b2cc0 secure :-1 s=READY pgs=3253 cs=0 l=1 rev1=1 crypto rx=0x7f9a380b5680 tx=0x7f9a3002bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ac8e2e84a53ba7 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.527 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 1 -- 172.21.15.116:0/1399025209 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3002cc50 con 0x7f9a38142620 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: dump: 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.528 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: _finish_auth 0 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: _check_auth_tickets 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 1 -- 172.21.15.116:0/1399025209 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3002cdb0 con 0x7f9a38142620 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 1 -- 172.21.15.116:0/1399025209 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30034660 con 0x7f9a38142620 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3d1c9640 5 monclient: authenticate success, global_id 16587 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3d1c9640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3d1c9640 4 set_mon_vals no callback set 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.528+0000 7f9a3659c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3659c640 10 monclient: dump: 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.529 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.530 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 10 monclient: shutdown 2024-01-23T08:10:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/1399025209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142620 msgr2=0x7f9a380b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 1 --2- 172.21.15.116:0/1399025209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142620 0x7f9a380b2cc0 secure :-1 s=READY pgs=3253 cs=0 l=1 rev1=1 crypto rx=0x7f9a380b5680 tx=0x7f9a3002bf20 comp rx=0 tx=0).stop 2024-01-23T08:10:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/1399025209 shutdown_connections 2024-01-23T08:10:33.534 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 1 --2- 172.21.15.116:0/1399025209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142620 0x7f9a380b2cc0 unknown :-1 s=CLOSED pgs=3253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/1399025209 >> 172.21.15.116:0/1399025209 conn(0x7f9a38066450 msgr2=0x7f9a38066860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/1399025209 shutdown_connections 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.529+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/1399025209 wait complete. 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 10 monclient: build_initial_monmap 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 10 monclient: monmap: 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:33.535 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 1 librados: starting msgr at 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 1 librados: starting objecter 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 1 Processor -- start 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 1 -- start start 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 1 librados: setting wanted keys 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 1 librados: calling monclient init 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.530+0000 7f9a3d1c9640 10 monclient: init 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient: _add_conns ranks=[1,0,2] 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3813f9a0 0x7f9a380b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): picked mon.noname-b con 0x7f9a3813f9a0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:33.536 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142240 0x7f9a38138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): picked mon.noname-a con 0x7f9a38142240 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a38142620 0x7f9a381da380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): picked mon.noname-c con 0x7f9a38142620 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3813a210 con 0x7f9a38142240 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a381388b0 con 0x7f9a3813f9a0 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38138db0 con 0x7f9a38142620 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a3d1c9640 10 monclient(hunting): authenticate will time out at 4640.888648s 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.531+0000 7f9a2ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142240 0x7f9a38138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.537 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a3759e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a38142620 0x7f9a381da380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142240 0x7f9a38138290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33944/0 (socket says 172.21.15.116:33944) 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 1 -- 172.21.15.116:0/2254457063 learned_addr learned my addr 172.21.15.116:0/2254457063 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 10 monclient(hunting): get_auth_request con 0x7f9a38142240 auth_method 0 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a36d9d640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3813f9a0 0x7f9a380b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a3759e640 10 monclient(hunting): get_auth_request con 0x7f9a38142620 auth_method 0 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a3759e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a3759e640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a3759e640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:33.538 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a36d9d640 10 monclient(hunting): get_auth_request con 0x7f9a3813f9a0 auth_method 0 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a36d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a36d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.532+0000 7f9a36d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.533+0000 7f9a3759e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.533+0000 7f9a3759e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.533+0000 7f9a3759e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.533+0000 7f9a36d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.533+0000 7f9a36d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.533+0000 7f9a36d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 10 monclient(hunting): handle_auth_done global_id 16593 payload 824 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 1 -- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a38142620 msgr2=0x7f9a381da380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.539 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f9a38142620 0x7f9a381da380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 1 -- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3813f9a0 msgr2=0x7f9a380b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a3813f9a0 0x7f9a380b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 10 monclient: _finish_hunting 0 2024-01-23T08:10:33.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 1 monclient: found mon.noname-a 2024-01-23T08:10:33.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:33.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.540 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.535+0000 7f9a2ffff640 1 -- 172.21.15.116:0/2254457063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30009a70 con 0x7f9a38142240 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.537+0000 7f9a2ffff640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142240 0x7f9a38138290 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c400 tx=0x7f9a2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.537+0000 7f9a2f7fe640 10 client.?.objecter ms_handle_connect 0x7f9a38142240 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.537+0000 7f9a2f7fe640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.540+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200052d0 con 0x7f9a38142240 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.540+0000 7f9a2f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.540+0000 7f9a2f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.540+0000 7f9a2f7fe640 10 monclient: dump: 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.542 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 10 monclient: _finish_auth 0 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 10 monclient: _check_auth_tickets 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a20005430 con 0x7f9a38142240 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 5 monclient: authenticate success, global_id 16593 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 monclient: _renew_subs 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3813a630 con 0x7f9a38142240 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:33.543 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20003810 con 0x7f9a38142240 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a2f7fe640 10 monclient: dump: 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3559a640 4 set_mon_vals no callback set 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 client.16593.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 monclient: _renew_subs 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a381daaa0 con 0x7f9a38142240 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 1 librados: init done 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 client.16593.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 15 client.16593.objecter _session_command_op_assign -1 1 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 20 client.16593.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 client.16593.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.541+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a38139090 con 0x7f9a38142240 2024-01-23T08:10:33.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.563+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f9a20003970 con 0x7f9a38142240 2024-01-23T08:10:33.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.563+0000 7f9a2f7fe640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f9a1806c860 0x7f9a1806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.563+0000 7f9a36d9d640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f9a1806c860 0x7f9a1806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.563+0000 7f9a36d9d640 10 monclient: get_auth_request con 0x7f9a1806c860 auth_method 0 2024-01-23T08:10:33.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.564+0000 7f9a2f7fe640 10 client.16593.objecter ms_handle_connect 0x7f9a1806c860 2024-01-23T08:10:33.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.564+0000 7f9a36d9d640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f9a1806c860 0x7f9a1806ed20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9a28000f60 tx=0x7f9a28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f9a20057f80 con 0x7f9a38142240 2024-01-23T08:10:33.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 10 client.16593.objecter ms_dispatch 0x7f9a38000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 3 client.16593.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 3 client.16593.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 10 client.16593.objecter checking command 1 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f9a18074550 0x7f9a180769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 20 client.16593.objecter _get_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 20 client.16593.objecter put_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 15 client.16593.objecter _session_command_op_remove -1 1 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 20 client.16593.objecter _get_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 20 client.16593.objecter get_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 15 client.16593.objecter _session_command_op_assign 6 1 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 20 client.16593.objecter put_session s=0x7f9a18073e80 osd=6 4 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 10 client.16593.objecter _send_command 1 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 --> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a180770c0 con 0x7f9a18074550 2024-01-23T08:10:33.567 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.567+0000 7f9a2f7fe640 20 client.16593.objecter dump_active .. 0 homeless 2024-01-23T08:10:33.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.568+0000 7f9a3759e640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f9a18074550 0x7f9a180769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.568+0000 7f9a3759e640 10 monclient: get_auth_request con 0x7f9a18074550 auth_method 0 2024-01-23T08:10:33.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.570+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a200542c0 con 0x7f9a38142240 2024-01-23T08:10:33.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.570+0000 7f9a2f7fe640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:33.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.571+0000 7f9a2f7fe640 10 client.16593.objecter ms_handle_connect 0x7f9a18074550 2024-01-23T08:10:33.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.571+0000 7f9a3759e640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f9a18074550 0x7f9a180769f0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.595+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== osd.6 v2:172.21.15.173:6816/548415989 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9a180770c0 con 0x7f9a18074550 2024-01-23T08:10:33.594 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.595+0000 7f9a2f7fe640 10 client.16593.objecter ms_dispatch 0x7f9a38000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:33.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.595+0000 7f9a2f7fe640 10 client.16593.objecter _finish_command 1 = system:0 2024-01-23T08:10:33.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.595+0000 7f9a2f7fe640 20 client.16593.objecter put_session s=0x7f9a18073e80 osd=6 4 2024-01-23T08:10:33.595 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.595+0000 7f9a2f7fe640 15 client.16593.objecter _session_command_op_remove 6 1 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.608+0000 7f9a3d1c9640 10 client.16593.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.608+0000 7f9a3d1c9640 15 client.16593.objecter _session_command_op_assign -1 2 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.608+0000 7f9a3d1c9640 20 client.16593.objecter _get_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 20 client.16593.objecter put_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 20 client.16593.objecter _get_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 15 client.16593.objecter _session_command_op_remove -1 2 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 20 client.16593.objecter get_session s=0x7f9a18073e80 osd=6 3 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 15 client.16593.objecter _session_command_op_assign 6 2 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 20 client.16593.objecter put_session s=0x7f9a18073e80 osd=6 4 2024-01-23T08:10:33.608 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 10 client.16593.objecter _send_command 2 2024-01-23T08:10:33.609 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.609+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 --> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9a380ab0b0 con 0x7f9a18074550 2024-01-23T08:10:33.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.624+0000 7f9a2f7fe640 1 -- 172.21.15.116:0/2254457063 <== osd.6 v2:172.21.15.173:6816/548415989 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9a30009450 con 0x7f9a18074550 2024-01-23T08:10:33.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.624+0000 7f9a2f7fe640 10 client.16593.objecter ms_dispatch 0x7f9a38000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:33.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.624+0000 7f9a2f7fe640 10 client.16593.objecter _finish_command 2 = system:0 2024-01-23T08:10:33.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.624+0000 7f9a2f7fe640 20 client.16593.objecter put_session s=0x7f9a18073e80 osd=6 4 2024-01-23T08:10:33.623 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.624+0000 7f9a2f7fe640 15 client.16593.objecter _session_command_op_remove 6 2 2024-01-23T08:10:33.624 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:33.624 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:33.624 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:33.625 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.624+0000 7f9a3d1c9640 10 librados: watch_flush enter 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.624+0000 7f9a3d1c9640 10 librados: watch_flush exit 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 10 client.16593.objecter close_session for osd.6 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f9a18074550 msgr2=0x7f9a180769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.173:6816/548415989,v1:172.21.15.173:6817/548415989] conn(0x7f9a18074550 0x7f9a180769f0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 20 client.16593.objecter put_session s=0x7f9a18073e80 osd=6 1 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 20 client.16593.objecter shutdown clearing up homeless session... 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 10 client.16593.objecter successfully canceled tick 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f9a1806c860 msgr2=0x7f9a1806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f9a1806c860 0x7f9a1806ed20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9a28000f60 tx=0x7f9a28009040 comp rx=0 tx=0).stop 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 10 monclient: shutdown 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142240 msgr2=0x7f9a38138290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 --2- 172.21.15.116:0/2254457063 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9a38142240 0x7f9a38138290 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000c400 tx=0x7f9a2000c8c0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.626 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3759e640 1 -- 172.21.15.116:0/2254457063 reap_dead start 2024-01-23T08:10:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 shutdown_connections 2024-01-23T08:10:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 >> 172.21.15.116:0/2254457063 conn(0x7f9a38066450 msgr2=0x7f9a3813d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 shutdown_connections 2024-01-23T08:10:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 -- 172.21.15.116:0/2254457063 wait complete. 2024-01-23T08:10:33.627 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.625+0000 7f9a3d1c9640 1 librados: shutdown 2024-01-23T08:10:33.635 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-23T08:10:33.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.744+0000 7f2c0255d640 10 monclient: get_monmap_and_config 2024-01-23T08:10:33.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.744+0000 7f2c0255d640 10 monclient: build_initial_monmap 2024-01-23T08:10:33.743 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.744+0000 7f2c0255d640 10 monclient: monmap: 2024-01-23T08:10:33.743 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:33.743 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.743 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:33.744520+0000 2024-01-23T08:10:33.743 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:33.744520+0000 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:33.744 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 Processor -- start 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 -- start start 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient: init 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient: _add_conns ranks=[2,3,4,0,1] 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc0a96e0 0x7f2bfc0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): picked mon.noname-b con 0x7f2bfc0a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2bfc13f390 0x7f2bfc13f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): picked mon.noname-a con 0x7f2bfc13f390 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:33.746 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f2bfc145600 0x7f2bfc145a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): picked mon.noname-c con 0x7f2bfc145600 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0a9e00 con 0x7f2bfc13f390 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0aac10 con 0x7f2bfc145600 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc13fd30 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.745+0000 7f2c0255d640 10 monclient(hunting): authenticate will time out at 4641.102988s 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.746+0000 7f2bfb7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2bfc13f390 0x7f2bfc13f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.746+0000 7f2bfb7fe640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f2bfc13f390 0x7f2bfc13f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33950/0 (socket says 172.21.15.116:33950) 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.746+0000 7f2bfb7fe640 1 -- 172.21.15.116:0/3957638181 learned_addr learned my addr 172.21.15.116:0/3957638181 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.746+0000 7f2bfb7fe640 10 monclient(hunting): get_auth_request con 0x7f2bfc13f390 auth_method 0 2024-01-23T08:10:33.747 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.746+0000 7f2bfb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:33.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.746+0000 7f2bfb7fe640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:33.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.746+0000 7f2bfb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:33.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.747+0000 7f2bfb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:33.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.747+0000 7f2bfb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:33.748 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.747+0000 7f2bfb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 10 monclient(hunting): handle_auth_done global_id 16596 payload 274 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 1 -- 172.21.15.116:0/3957638181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc0a96e0 msgr2=0x7f2bfc0b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 1 --2- 172.21.15.116:0/3957638181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc0a96e0 0x7f2bfc0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 1 -- 172.21.15.116:0/3957638181 >> v2:172.21.15.173:3300/0 conn(0x7f2bfc145600 msgr2=0x7f2bfc145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 1 --2- 172.21.15.116:0/3957638181 >> v2:172.21.15.173:3300/0 conn(0x7f2bfc145600 0x7f2bfc145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 10 monclient: _finish_hunting 0 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 1 monclient: found mon.noname-a 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.748+0000 7f2bfb7fe640 1 -- 172.21.15.116:0/3957638181 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0a9ac0 con 0x7f2bfc13f390 2024-01-23T08:10:33.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.750+0000 7f2bfb7fe640 1 --2- 172.21.15.116:0/3957638181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc13f390 0x7f2bfc13f7f0 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0aa490 tx=0x7f2bf002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79444d6f019bb3d server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 1 -- 172.21.15.116:0/3957638181 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0004230 con 0x7f2bfc13f390 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: dump: 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.753 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: _finish_auth 0 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2c0255d640 5 monclient: authenticate success, global_id 16596 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 1 -- 172.21.15.116:0/3957638181 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0004390 con 0x7f2bfc13f390 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2c0255d640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2c0255d640 4 set_mon_vals no callback set 2024-01-23T08:10:33.754 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 1 -- 172.21.15.116:0/3957638181 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0003810 con 0x7f2bfc13f390 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2bfaffd640 10 monclient: dump: 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.755 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2c0255d640 10 monclient: shutdown 2024-01-23T08:10:33.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2c0255d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:33.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.754+0000 7f2c0255d640 1 -- 172.21.15.116:0/3957638181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc13f390 msgr2=0x7f2bfc13f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 --2- 172.21.15.116:0/3957638181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc13f390 0x7f2bfc13f7f0 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0aa490 tx=0x7f2bf002b8f0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.758 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 -- 172.21.15.116:0/3957638181 shutdown_connections 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 --2- 172.21.15.116:0/3957638181 >> v2:172.21.15.173:3300/0 conn(0x7f2bfc145600 0x7f2bfc145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 --2- 172.21.15.116:0/3957638181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc13f390 0x7f2bfc13f7f0 unknown :-1 s=CLOSED pgs=3255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 --2- 172.21.15.116:0/3957638181 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc0a96e0 0x7f2bfc0b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 -- 172.21.15.116:0/3957638181 >> 172.21.15.116:0/3957638181 conn(0x7f2bfc0b7bb0 msgr2=0x7f2bfc0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 -- 172.21.15.116:0/3957638181 shutdown_connections 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 1 -- 172.21.15.116:0/3957638181 wait complete. 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 10 monclient: build_initial_monmap 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.755+0000 7f2c0255d640 10 monclient: monmap: 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:33.759 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 librados: starting msgr at 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 librados: starting objecter 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 Processor -- start 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 -- start start 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 librados: setting wanted keys 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 librados: calling monclient init 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient: init 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient: _add_conns ranks=[0,2,1] 2024-01-23T08:10:33.760 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc0a96e0 0x7f2bfc1ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): picked mon.noname-a con 0x7f2bfc0a96e0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc13f390 0x7f2bfc0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): picked mon.noname-c con 0x7f2bfc13f390 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bfc145600 0x7f2bfc1cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): picked mon.noname-b con 0x7f2bfc145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1ce0c0 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1ce4e0 con 0x7f2bfc145600 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1ce780 con 0x7f2bfc13f390 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.756+0000 7f2c0255d640 10 monclient(hunting): authenticate will time out at 4641.114106s 2024-01-23T08:10:33.761 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.757+0000 7f2bfbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc0a96e0 0x7f2bfc1ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.757+0000 7f2bfbfff640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc0a96e0 0x7f2bfc1ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33952/0 (socket says 172.21.15.116:33952) 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.757+0000 7f2bfbfff640 1 -- 172.21.15.116:0/660127290 learned_addr learned my addr 172.21.15.116:0/660127290 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.757+0000 7f2bfbfff640 10 monclient(hunting): get_auth_request con 0x7f2bfc0a96e0 auth_method 0 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.757+0000 7f2bfbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.757+0000 7f2bfbfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.757+0000 7f2bfbfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.758+0000 7f2bfbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.758+0000 7f2bfbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:33.762 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.758+0000 7f2bfbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.760+0000 7f2bfbfff640 10 monclient(hunting): handle_auth_done global_id 16599 payload 824 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.760+0000 7f2bfbfff640 1 -- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc13f390 msgr2=0x7f2bfc0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.760+0000 7f2bfbfff640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc13f390 0x7f2bfc0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.761+0000 7f2bfbfff640 1 -- 172.21.15.116:0/660127290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bfc145600 msgr2=0x7f2bfc1cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.761+0000 7f2bfbfff640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bfc145600 0x7f2bfc1cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.761+0000 7f2bfbfff640 10 monclient: _finish_hunting 0 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.761+0000 7f2bfbfff640 1 monclient: found mon.noname-a 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.761+0000 7f2bfbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:33.763 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.761+0000 7f2bfbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.761+0000 7f2bfbfff640 1 -- 172.21.15.116:0/660127290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009460 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.763+0000 7f2bfbfff640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc0a96e0 0x7f2bfc1ceca0 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b4a0 tx=0x7f2bec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.763+0000 7f2bf8ff9640 10 client.?.objecter ms_handle_connect 0x7f2bfc0a96e0 2024-01-23T08:10:33.764 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.763+0000 7f2bf8ff9640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:33.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 1 -- 172.21.15.116:0/660127290 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec010610 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:33.766 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: dump: 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: _finish_auth 0 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: _check_auth_tickets 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 5 monclient: authenticate success, global_id 16599 2024-01-23T08:10:33.767 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 1 -- 172.21.15.116:0/660127290 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec010770 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 1 -- 172.21.15.116:0/660127290 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec010b20 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bf8ff9640 10 monclient: dump: 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:33.768 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 10 monclient: _renew_subs 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2bfa7fc640 4 set_mon_vals no callback set 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc1cceb0 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 10 client.16599.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 10 monclient: _renew_subs 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc1cbbd0 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.769 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.767+0000 7f2c0255d640 1 librados: init done 2024-01-23T08:10:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.768+0000 7f2c0255d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.768+0000 7f2c0255d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.768+0000 7f2c0255d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:33.770 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.768+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc067d70 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.788 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.789+0000 7f2bf8ff9640 1 -- 172.21.15.116:0/660127290 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f2bec010c80 con 0x7f2bfc0a96e0 2024-01-23T08:10:33.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.789+0000 7f2bf8ff9640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2be806c8e0 0x7f2be806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:33.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.790+0000 7f2bfb7fe640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2be806c8e0 0x7f2be806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:33.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.790+0000 7f2bfb7fe640 10 monclient: get_auth_request con 0x7f2be806c8e0 auth_method 0 2024-01-23T08:10:33.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.790+0000 7f2bfb7fe640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2be806c8e0 0x7f2be806eda0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0035000 tx=0x7f2bf0030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:33.789 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:33.790+0000 7f2bf8ff9640 10 client.16599.objecter ms_handle_connect 0x7f2be806c8e0 2024-01-23T08:10:34.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 1 -- 172.21.15.116:0/660127290 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f2bec058930 con 0x7f2bfc0a96e0 2024-01-23T08:10:34.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 10 client.16599.objecter ms_dispatch 0x7f2bfc000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:34.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 3 client.16599.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:34.038 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 3 client.16599.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:34.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 20 client.16599.objecter dump_active .. 0 homeless 2024-01-23T08:10:34.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 1 -- 172.21.15.116:0/660127290 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f2bec054570 con 0x7f2bfc0a96e0 2024-01-23T08:10:34.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:34.039 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.039+0000 7f2bf8ff9640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:34.215 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.216+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2bfc13cbf0 con 0x7f2be806c8e0 2024-01-23T08:10:34.216 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.216+0000 7f2bf8ff9640 1 -- 172.21.15.116:0/660127290 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2bfc13cbf0 con 0x7f2be806c8e0 2024-01-23T08:10:34.216 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 6 to deep-scrub 2024-01-23T08:10:34.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 10 librados: watch_flush enter 2024-01-23T08:10:34.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 10 librados: watch_flush exit 2024-01-23T08:10:34.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 20 client.16599.objecter shutdown clearing up homeless session... 2024-01-23T08:10:34.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 10 client.16599.objecter successfully canceled tick 2024-01-23T08:10:34.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2be806c8e0 msgr2=0x7f2be806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.218 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2be806c8e0 0x7f2be806eda0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0035000 tx=0x7f2bf0030000 comp rx=0 tx=0).stop 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 10 monclient: shutdown 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc0a96e0 msgr2=0x7f2bfc1ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.218+0000 7f2c0255d640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc0a96e0 0x7f2bfc1ceca0 secure :-1 s=READY pgs=3256 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00b4a0 tx=0x7f2bec00b960 comp rx=0 tx=0).stop 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 shutdown_connections 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f2be806c8e0 0x7f2be806eda0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2bfc145600 0x7f2bfc1cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f2bfc13f390 0x7f2bfc0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 --2- 172.21.15.116:0/660127290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2bfc0a96e0 0x7f2bfc1ceca0 unknown :-1 s=CLOSED pgs=3256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 >> 172.21.15.116:0/660127290 conn(0x7f2bfc0b7bb0 msgr2=0x7f2bfc13a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 shutdown_connections 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 -- 172.21.15.116:0/660127290 wait complete. 2024-01-23T08:10:34.219 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.219+0000 7f2c0255d640 1 librados: shutdown 2024-01-23T08:10:34.229 INFO:tasks.ceph:Scrubbing osd.7 2024-01-23T08:10:34.229 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-23T08:10:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.332+0000 7f5943c1d640 10 monclient: get_monmap_and_config 2024-01-23T08:10:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.332+0000 7f5943c1d640 10 monclient: build_initial_monmap 2024-01-23T08:10:34.331 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.332+0000 7f5943c1d640 10 monclient: monmap: 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:34.332588+0000 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:34.332588+0000 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.332 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.332+0000 7f5943c1d640 1 Processor -- start 2024-01-23T08:10:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 1 -- start start 2024-01-23T08:10:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient: init 2024-01-23T08:10:34.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient: _add_conns ranks=[4,3,0,1,2] 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f593c0ae420 0x7f593c0ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient(hunting): picked mon.noname-c con 0x7f593c0ae420 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f593c0ab910 0x7f593c13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient(hunting): picked mon.noname-a con 0x7f593c0ab910 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f593c0aa580 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c13c960 con 0x7f593c0aa580 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c0ade90 con 0x7f593c0ab910 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c0acc50 con 0x7f593c0ae420 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.333+0000 7f5943c1d640 10 monclient(hunting): authenticate will time out at 4641.690987s 2024-01-23T08:10:34.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59419b9640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f593c0ae420 0x7f593c0ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59411b8640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f593c0ab910 0x7f593c13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59421ba640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f593c0aa580 0x7f593c142210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51798/0 (socket says 172.21.15.116:51798) 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59421ba640 1 -- 172.21.15.116:0/1350565587 learned_addr learned my addr 172.21.15.116:0/1350565587 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59419b9640 10 monclient(hunting): get_auth_request con 0x7f593c0ae420 auth_method 0 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59419b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59419b9640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.334+0000 7f59419b9640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59411b8640 10 monclient(hunting): get_auth_request con 0x7f593c0ab910 auth_method 0 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59411b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59411b8640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59411b8640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59419b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59419b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59419b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59411b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59411b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.335+0000 7f59411b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.336+0000 7f59419b9640 10 monclient(hunting): handle_auth_done global_id 20983 payload 274 2024-01-23T08:10:34.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.336+0000 7f59419b9640 1 -- 172.21.15.116:0/1350565587 >> v2:172.21.15.116:3300/0 conn(0x7f593c0ab910 msgr2=0x7f593c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.336+0000 7f59419b9640 1 --2- 172.21.15.116:0/1350565587 >> v2:172.21.15.116:3300/0 conn(0x7f593c0ab910 0x7f593c13ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.336+0000 7f59419b9640 1 -- 172.21.15.116:0/1350565587 >> v1:172.21.15.116:6789/0 conn(0x7f593c0aa580 legacy=0x7f593c142210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.337+0000 7f59419b9640 10 monclient: _finish_hunting 0 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.337+0000 7f59419b9640 1 monclient: found mon.noname-c 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.337+0000 7f59419b9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.337+0000 7f59419b9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.173:3300/0 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.337+0000 7f59419b9640 1 -- 172.21.15.116:0/1350565587 --> v2:172.21.15.173:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c0ab4c0 con 0x7f593c0ae420 2024-01-23T08:10:34.338 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.339+0000 7f59419b9640 1 --2- 172.21.15.116:0/1350565587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 0x7f593c0ad950 secure :-1 s=READY pgs=5231 cs=0 l=1 rev1=1 crypto rx=0x7f593c0afce0 tx=0x7f593802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b7afa361f97fe29 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 1 -- 172.21.15.116:0/1350565587 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593802e070 con 0x7f593c0ae420 2024-01-23T08:10:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: dump: 2024-01-23T08:10:34.342 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: _finish_auth 0 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: _check_auth_tickets 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 1 -- 172.21.15.116:0/1350565587 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59380315a0 con 0x7f593c0ae420 2024-01-23T08:10:34.343 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 1 -- 172.21.15.116:0/1350565587 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938031930 con 0x7f593c0ae420 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f59409b7640 10 monclient: dump: 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.344 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f5943c1d640 5 monclient: authenticate success, global_id 20983 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f5943c1d640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.342+0000 7f5943c1d640 4 set_mon_vals no callback set 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 10 monclient: shutdown 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 -- 172.21.15.116:0/1350565587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 msgr2=0x7f593c0ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 --2- 172.21.15.116:0/1350565587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 0x7f593c0ad950 secure :-1 s=READY pgs=5231 cs=0 l=1 rev1=1 crypto rx=0x7f593c0afce0 tx=0x7f593802b840 comp rx=0 tx=0).stop 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 -- 172.21.15.116:0/1350565587 shutdown_connections 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 --2- 172.21.15.116:0/1350565587 >> v2:172.21.15.116:3300/0 conn(0x7f593c0ab910 0x7f593c13ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 --2- 172.21.15.116:0/1350565587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 0x7f593c0ad950 unknown :-1 s=CLOSED pgs=5231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 -- 172.21.15.116:0/1350565587 >> 172.21.15.116:0/1350565587 conn(0x7f593c0b08e0 msgr2=0x7f593c06a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 -- 172.21.15.116:0/1350565587 shutdown_connections 2024-01-23T08:10:34.345 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.343+0000 7f5943c1d640 1 -- 172.21.15.116:0/1350565587 wait complete. 2024-01-23T08:10:34.348 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 10 monclient: build_initial_monmap 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 10 monclient: monmap: 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 1 librados: starting msgr at 2024-01-23T08:10:34.349 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 1 librados: starting objecter 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 1 Processor -- start 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 1 -- start start 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 1 librados: setting wanted keys 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 1 librados: calling monclient init 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.344+0000 7f5943c1d640 10 monclient: init 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f593c0aa580 0x7f593c06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): picked mon.noname-c con 0x7f593c0aa580 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f593c0ab910 0x7f593c1d7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): picked mon.noname-a con 0x7f593c0ab910 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 0x7f593c1d7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): picked mon.noname-b con 0x7f593c0ae420 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:34.350 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c06f310 con 0x7f593c0ab910 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c071320 con 0x7f593c0ae420 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c06f7a0 con 0x7f593c0aa580 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f5943c1d640 10 monclient(hunting): authenticate will time out at 4641.702324s 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59411b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f593c0ab910 0x7f593c1d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59421ba640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 0x7f593c1d7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59419b9640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f593c0aa580 0x7f593c06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59411b8640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f593c0ab910 0x7f593c1d7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33978/0 (socket says 172.21.15.116:33978) 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59411b8640 1 -- 172.21.15.116:0/1585758030 learned_addr learned my addr 172.21.15.116:0/1585758030 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59411b8640 10 monclient(hunting): get_auth_request con 0x7f593c0ab910 auth_method 0 2024-01-23T08:10:34.351 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59411b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59411b8640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59411b8640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59421ba640 10 monclient(hunting): get_auth_request con 0x7f593c0ae420 auth_method 0 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59421ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59421ba640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.345+0000 7f59421ba640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59419b9640 10 monclient(hunting): get_auth_request con 0x7f593c0aa580 auth_method 0 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59419b9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59419b9640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59419b9640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59411b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59411b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59411b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59421ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.352 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59421ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59421ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59419b9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59419b9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.346+0000 7f59419b9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 10 monclient(hunting): handle_auth_done global_id 20986 payload 824 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 1 -- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f593c0aa580 msgr2=0x7f593c06fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f593c0aa580 0x7f593c06fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 1 -- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f593c0ab910 msgr2=0x7f593c1d7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f593c0ab910 0x7f593c1d7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 10 monclient: _finish_hunting 0 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 1 monclient: found mon.noname-b 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:34.353 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.348+0000 7f59421ba640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:34.354 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.349+0000 7f59421ba640 1 -- 172.21.15.116:0/1585758030 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009400 con 0x7f593c0ae420 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.351+0000 7f59421ba640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 0x7f593c1d7bd0 secure :-1 s=READY pgs=5232 cs=0 l=1 rev1=1 crypto rx=0x7f593400caa0 tx=0x7f593400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.351+0000 7f59327fc640 10 client.?.objecter ms_handle_connect 0x7f593c0ae420 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.351+0000 7f59327fc640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400ac00 con 0x7f593c0ae420 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: dump: 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.355 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: _finish_auth 0 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: _check_auth_tickets 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400ad60 con 0x7f593c0ae420 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934012600 con 0x7f593c0ae420 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:34.356 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f59327fc640 10 monclient: dump: 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 5 monclient: authenticate success, global_id 20986 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 10 monclient: _renew_subs 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5933fff640 4 set_mon_vals no callback set 2024-01-23T08:10:34.357 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c06eec0 con 0x7f593c0ae420 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 10 client.20986.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 10 monclient: _renew_subs 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c070320 con 0x7f593c0ae420 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.354+0000 7f5943c1d640 1 librados: init done 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.355+0000 7f5943c1d640 10 client.20986.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.355+0000 7f5943c1d640 15 client.20986.objecter _session_command_op_assign -1 1 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.355+0000 7f5943c1d640 20 client.20986.objecter _get_session osd=-1 returning homeless 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.355+0000 7f5943c1d640 10 client.20986.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.355+0000 7f5943c1d640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:34.358 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.355+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f593c139500 con 0x7f593c0ae420 2024-01-23T08:10:34.373 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.374+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5934007070 con 0x7f593c0ae420 2024-01-23T08:10:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.375+0000 7f59327fc640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f592006c8e0 0x7f592006eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.375+0000 7f59419b9640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f592006c8e0 0x7f592006eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.375+0000 7f59419b9640 10 monclient: get_auth_request con 0x7f592006c8e0 auth_method 0 2024-01-23T08:10:34.374 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.375+0000 7f59327fc640 10 client.20986.objecter ms_handle_connect 0x7f592006c8e0 2024-01-23T08:10:34.375 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.375+0000 7f59419b9640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f592006c8e0 0x7f592006eda0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5938036000 tx=0x7f593803d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f5934058860 con 0x7f593c0ae420 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 10 client.20986.objecter ms_dispatch 0x7f593c000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 3 client.20986.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 3 client.20986.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 10 client.20986.objecter checking command 1 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7f5920074660 0x7f5920076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 20 client.20986.objecter _get_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 20 client.20986.objecter put_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 15 client.20986.objecter _session_command_op_remove -1 1 2024-01-23T08:10:34.376 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 20 client.20986.objecter _get_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 20 client.20986.objecter get_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 15 client.20986.objecter _session_command_op_assign 7 1 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 20 client.20986.objecter put_session s=0x7f5920073f90 osd=7 4 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 10 client.20986.objecter _send_command 1 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 --> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59200771d0 con 0x7f5920074660 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 20 client.20986.objecter dump_active .. 0 homeless 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_get_version_reply(handle=1 version=1323) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5934001b40 con 0x7f593c0ae420 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.376+0000 7f59327fc640 10 monclient: handle_get_version_reply finishing 1 version 1323 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.377+0000 7f59411b8640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7f5920074660 0x7f5920076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.377 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.377+0000 7f59411b8640 10 monclient: get_auth_request con 0x7f5920074660 auth_method 0 2024-01-23T08:10:34.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.380+0000 7f59411b8640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7f5920074660 0x7f5920076b00 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:34.379 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.380+0000 7f59327fc640 10 client.20986.objecter ms_handle_connect 0x7f5920074660 2024-01-23T08:10:34.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.403+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== osd.7 v2:172.21.15.173:6824/1205985563 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f59200771d0 con 0x7f5920074660 2024-01-23T08:10:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.403+0000 7f59327fc640 10 client.20986.objecter ms_dispatch 0x7f593c000b90 command_reply(tid 1: 0 ) v1 2024-01-23T08:10:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.403+0000 7f59327fc640 10 client.20986.objecter _finish_command 1 = system:0 2024-01-23T08:10:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.403+0000 7f59327fc640 20 client.20986.objecter put_session s=0x7f5920073f90 osd=7 4 2024-01-23T08:10:34.403 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.403+0000 7f59327fc640 15 client.20986.objecter _session_command_op_remove 7 1 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 10 client.20986.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 15 client.20986.objecter _session_command_op_assign -1 2 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 20 client.20986.objecter _get_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 20 client.20986.objecter put_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 20 client.20986.objecter _get_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 15 client.20986.objecter _session_command_op_remove -1 2 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 20 client.20986.objecter get_session s=0x7f5920073f90 osd=7 3 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 15 client.20986.objecter _session_command_op_assign 7 2 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 20 client.20986.objecter put_session s=0x7f5920073f90 osd=7 4 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 10 client.20986.objecter _send_command 2 2024-01-23T08:10:34.419 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.420+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 --> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f593c13f250 con 0x7f5920074660 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f59327fc640 1 -- 172.21.15.116:0/1585758030 <== osd.7 v2:172.21.15.173:6824/1205985563 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f592c009930 con 0x7f5920074660 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f59327fc640 10 client.20986.objecter ms_dispatch 0x7f593c000b90 command_reply(tid 2: 0 ) v1 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f59327fc640 10 client.20986.objecter _finish_command 2 = system:0 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f59327fc640 20 client.20986.objecter put_session s=0x7f5920073f90 osd=7 4 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f59327fc640 15 client.20986.objecter _session_command_op_remove 7 2 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-23T08:10:34.432 INFO:teuthology.orchestra.run.smithi116.stdout:} 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 10 librados: watch_flush enter 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 10 librados: watch_flush exit 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 10 client.20986.objecter close_session for osd.7 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7f5920074660 msgr2=0x7f5920076b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:6824/1205985563,v1:172.21.15.173:6825/1205985563] conn(0x7f5920074660 0x7f5920076b00 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 20 client.20986.objecter put_session s=0x7f5920073f90 osd=7 1 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 20 client.20986.objecter shutdown clearing up homeless session... 2024-01-23T08:10:34.434 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 10 client.20986.objecter successfully canceled tick 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f592006c8e0 msgr2=0x7f592006eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f592006c8e0 0x7f592006eda0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5938036000 tx=0x7f593803d040 comp rx=0 tx=0).stop 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 10 monclient: shutdown 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 msgr2=0x7f593c1d7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 --2- 172.21.15.116:0/1585758030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f593c0ae420 0x7f593c1d7bd0 secure :-1 s=READY pgs=5232 cs=0 l=1 rev1=1 crypto rx=0x7f593400caa0 tx=0x7f593400cf60 comp rx=0 tx=0).stop 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f59421ba640 1 -- 172.21.15.116:0/1585758030 reap_dead start 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 shutdown_connections 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 >> 172.21.15.116:0/1585758030 conn(0x7f593c0b08e0 msgr2=0x7f593c06a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 shutdown_connections 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 -- 172.21.15.116:0/1585758030 wait complete. 2024-01-23T08:10:34.435 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.433+0000 7f5943c1d640 1 librados: shutdown 2024-01-23T08:10:34.443 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-23T08:10:34.544 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.545+0000 7f3903489640 10 monclient: get_monmap_and_config 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.545+0000 7f3903489640 10 monclient: build_initial_monmap 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.545+0000 7f3903489640 10 monclient: monmap: 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:34.545875+0000 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:34.545875+0000 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.545 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:34.546 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:34.546 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.546+0000 7f3903489640 1 Processor -- start 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.546+0000 7f3903489640 1 -- start start 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.546+0000 7f3903489640 10 monclient: init 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.546+0000 7f3903489640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient: _add_conns ranks=[0,3,2,4,1] 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f38fc070640 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f38fc13fe80 0x7f38fc140310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient(hunting): picked mon.noname-a con 0x7f38fc13fe80 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc148780 0x7f38fc14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.548 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient(hunting): picked mon.noname-b con 0x7f38fc148780 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38fc071030 con 0x7f38fc070640 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38fc072040 con 0x7f38fc13fe80 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0afaa0 con 0x7f38fc148780 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3903489640 10 monclient(hunting): authenticate will time out at 4641.904306s 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3901a26640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc148780 0x7f38fc14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3900a24640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f38fc13fe80 0x7f38fc140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3901225640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f38fc070640 0x7f38fc0af390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:51802/0 (socket says 172.21.15.116:51802) 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.547+0000 7f3901225640 1 -- 172.21.15.116:0/273542061 learned_addr learned my addr 172.21.15.116:0/273542061 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3901a26640 10 monclient(hunting): get_auth_request con 0x7f38fc148780 auth_method 0 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3901a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.549 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3901a26640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3901a26640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3900a24640 10 monclient(hunting): get_auth_request con 0x7f38fc13fe80 auth_method 0 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3900a24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3900a24640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3900a24640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3901a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3901a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3901a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3900a24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3900a24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.550 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.548+0000 7f3900a24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 10 monclient(hunting): handle_auth_done global_id 28487 payload 274 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 1 -- 172.21.15.116:0/273542061 >> v2:172.21.15.116:3300/0 conn(0x7f38fc13fe80 msgr2=0x7f38fc140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 1 --2- 172.21.15.116:0/273542061 >> v2:172.21.15.116:3300/0 conn(0x7f38fc13fe80 0x7f38fc140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 1 -- 172.21.15.116:0/273542061 >> v1:172.21.15.116:6789/0 conn(0x7f38fc070640 legacy=0x7f38fc0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 10 monclient: _finish_hunting 0 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 1 monclient: found mon.noname-b 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:34.551 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.550+0000 7f3901a26640 1 -- 172.21.15.116:0/273542061 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc06f8a0 con 0x7f38fc148780 2024-01-23T08:10:34.552 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.552+0000 7f3901a26640 1 --2- 172.21.15.116:0/273542061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc148780 0x7f38fc14ab70 secure :-1 s=READY pgs=3335 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009dc0 tx=0x7f38f402be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca1400fb264c1953 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:34.554 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 1 -- 172.21.15.116:0/273542061 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f402cbb0 con 0x7f38fc148780 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: dump: 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.555 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: _finish_auth 0 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 1 -- 172.21.15.116:0/273542061 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f402cd10 con 0x7f38fc148780 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 1 -- 172.21.15.116:0/273542061 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4034660 con 0x7f38fc148780 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f38f3fff640 10 monclient: dump: 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.556 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.557 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f3903489640 5 monclient: authenticate success, global_id 28487 2024-01-23T08:10:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f3903489640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:34.557 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.555+0000 7f3903489640 4 set_mon_vals no callback set 2024-01-23T08:10:34.560 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 10 monclient: shutdown 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 -- 172.21.15.116:0/273542061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc148780 msgr2=0x7f38fc14ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 --2- 172.21.15.116:0/273542061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc148780 0x7f38fc14ab70 secure :-1 s=READY pgs=3335 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009dc0 tx=0x7f38f402be00 comp rx=0 tx=0).stop 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 -- 172.21.15.116:0/273542061 shutdown_connections 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 --2- 172.21.15.116:0/273542061 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc148780 0x7f38fc14ab70 unknown :-1 s=CLOSED pgs=3335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 --2- 172.21.15.116:0/273542061 >> v2:172.21.15.116:3300/0 conn(0x7f38fc13fe80 0x7f38fc140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 -- 172.21.15.116:0/273542061 >> 172.21.15.116:0/273542061 conn(0x7f38fc066d90 msgr2=0x7f38fc0b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 -- 172.21.15.116:0/273542061 shutdown_connections 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.556+0000 7f3903489640 1 -- 172.21.15.116:0/273542061 wait complete. 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 10 monclient: build_initial_monmap 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 10 monclient: monmap: 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:34.561 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 1 librados: starting msgr at 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 1 librados: starting objecter 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 1 Processor -- start 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 1 -- start start 2024-01-23T08:10:34.562 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 1 librados: setting wanted keys 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 1 librados: calling monclient init 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.557+0000 7f3903489640 10 monclient: init 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient: _add_conns ranks=[1,2,0] 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38fc070640 0x7f38fc147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): picked mon.noname-b con 0x7f38fc070640 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc13fe80 0x7f38fc0ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): picked mon.noname-c con 0x7f38fc13fe80 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:34.563 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38fc148780 0x7f38fc0ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): picked mon.noname-a con 0x7f38fc148780 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0aaf90 con 0x7f38fc148780 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0a9810 con 0x7f38fc070640 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38fc0a9470 con 0x7f38fc13fe80 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3903489640 10 monclient(hunting): authenticate will time out at 4641.915587s 2024-01-23T08:10:34.564 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3900a24640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc13fe80 0x7f38fc0ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.558+0000 7f3901a26640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38fc148780 0x7f38fc0ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38fc070640 0x7f38fc147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38fc148780 0x7f38fc0ab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:33988/0 (socket says 172.21.15.116:33988) 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 1 -- 172.21.15.116:0/3344327663 learned_addr learned my addr 172.21.15.116:0/3344327663 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 10 monclient(hunting): get_auth_request con 0x7f38fc148780 auth_method 0 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3900a24640 10 monclient(hunting): get_auth_request con 0x7f38fc13fe80 auth_method 0 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3900a24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3900a24640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3900a24640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 10 monclient(hunting): get_auth_request con 0x7f38fc070640 auth_method 0 2024-01-23T08:10:34.565 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901a26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3900a24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3900a24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3900a24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:34.566 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.559+0000 7f3901225640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:34.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 10 monclient(hunting): handle_auth_done global_id 16611 payload 824 2024-01-23T08:10:34.568 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 1 -- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc13fe80 msgr2=0x7f38fc0ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc13fe80 0x7f38fc0ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 1 -- 172.21.15.116:0/3344327663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38fc070640 msgr2=0x7f38fc147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38fc070640 0x7f38fc147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 10 monclient: _finish_hunting 0 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 1 monclient: found mon.noname-a 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3901a26640 1 -- 172.21.15.116:0/3344327663 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009a70 con 0x7f38fc148780 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.562+0000 7f3900a24640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc13fe80 0x7f38fc0ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.564+0000 7f3901a26640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38fc148780 0x7f38fc0ab3b0 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 crypto rx=0x7f38f4037040 tx=0x7f38f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.564+0000 7f38f1ffb640 10 client.?.objecter ms_handle_connect 0x7f38fc148780 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.564+0000 7f38f1ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.567+0000 7f38f1ffb640 1 -- 172.21.15.116:0/3344327663 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4040650 con 0x7f38fc148780 2024-01-23T08:10:34.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: dump: 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.570 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 1 -- 172.21.15.116:0/3344327663 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f40407b0 con 0x7f38fc148780 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 5 monclient: authenticate success, global_id 16611 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 10 monclient: _renew_subs 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38fc0a9d10 con 0x7f38fc148780 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 1 -- 172.21.15.116:0/3344327663 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4040b60 con 0x7f38fc148780 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f1ffb640 10 monclient: dump: 2024-01-23T08:10:34.571 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f38f37fe640 4 set_mon_vals no callback set 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 10 client.16611.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 10 monclient: _renew_subs 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:34.572 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38fc0abad0 con 0x7f38fc148780 2024-01-23T08:10:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.568+0000 7f3903489640 1 librados: init done 2024-01-23T08:10:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.569+0000 7f3903489640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.569+0000 7f3903489640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.569+0000 7f3903489640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:34.573 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.569+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38fc0a99d0 con 0x7f38fc148780 2024-01-23T08:10:34.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.586+0000 7f38f1ffb640 1 -- 172.21.15.116:0/3344327663 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f38f4040cc0 con 0x7f38fc148780 2024-01-23T08:10:34.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.587+0000 7f38f1ffb640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f38e006c8b0 0x7f38e006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:34.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.587+0000 7f3901225640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f38e006c8b0 0x7f38e006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:34.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.587+0000 7f3901225640 10 monclient: get_auth_request con 0x7f38e006c8b0 auth_method 0 2024-01-23T08:10:34.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.587+0000 7f3901225640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f38e006c8b0 0x7f38e006ed70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007fd0 tx=0x7f38f8007e80 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:34.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.587+0000 7f38f1ffb640 10 client.16611.objecter ms_handle_connect 0x7f38e006c8b0 2024-01-23T08:10:34.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.589+0000 7f38f1ffb640 1 -- 172.21.15.116:0/3344327663 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f38f407b2d0 con 0x7f38fc148780 2024-01-23T08:10:34.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.589+0000 7f38f1ffb640 10 client.16611.objecter ms_dispatch 0x7f38fc000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:34.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.589+0000 7f38f1ffb640 3 client.16611.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:34.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.589+0000 7f38f1ffb640 3 client.16611.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:34.588 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.589+0000 7f38f1ffb640 20 client.16611.objecter dump_active .. 0 homeless 2024-01-23T08:10:34.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.827+0000 7f38f1ffb640 1 -- 172.21.15.116:0/3344327663 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f38f4077610 con 0x7f38fc148780 2024-01-23T08:10:34.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.827+0000 7f38f1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:34.826 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:34.827+0000 7f38f1ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:35.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.012+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f38fc071570 con 0x7f38e006c8b0 2024-01-23T08:10:35.012 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.012+0000 7f38f1ffb640 1 -- 172.21.15.116:0/3344327663 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38fc071570 con 0x7f38e006c8b0 2024-01-23T08:10:35.012 INFO:teuthology.orchestra.run.smithi116.stderr:instructed osd(s) 7 to deep-scrub 2024-01-23T08:10:35.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 10 librados: watch_flush enter 2024-01-23T08:10:35.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 10 librados: watch_flush exit 2024-01-23T08:10:35.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 20 client.16611.objecter shutdown clearing up homeless session... 2024-01-23T08:10:35.014 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 10 client.16611.objecter successfully canceled tick 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f38e006c8b0 msgr2=0x7f38e006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f38e006c8b0 0x7f38e006ed70 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f38f8007fd0 tx=0x7f38f8007e80 comp rx=0 tx=0).stop 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 10 monclient: shutdown 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38fc148780 msgr2=0x7f38fc0ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38fc148780 0x7f38fc0ab3b0 secure :-1 s=READY pgs=3259 cs=0 l=1 rev1=1 crypto rx=0x7f38f4037040 tx=0x7f38f4004a40 comp rx=0 tx=0).stop 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 shutdown_connections 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f38e006c8b0 0x7f38e006ed70 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38fc148780 0x7f38fc0ab3b0 unknown :-1 s=CLOSED pgs=3259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f38fc13fe80 0x7f38fc0ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.014+0000 7f3903489640 1 --2- 172.21.15.116:0/3344327663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f38fc070640 0x7f38fc147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.015+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 >> 172.21.15.116:0/3344327663 conn(0x7f38fc066d90 msgr2=0x7f38fc0b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.015+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 shutdown_connections 2024-01-23T08:10:35.015 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.015+0000 7f3903489640 1 -- 172.21.15.116:0/3344327663 wait complete. 2024-01-23T08:10:35.016 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.015+0000 7f3903489640 1 librados: shutdown 2024-01-23T08:10:35.026 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:10:35.128 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.129+0000 7f551b699640 10 monclient: get_monmap_and_config 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.129+0000 7f551b699640 10 monclient: build_initial_monmap 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.129+0000 7f551b699640 10 monclient: monmap: 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:35.130020+0000 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:35.130020+0000 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:35.129 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.130+0000 7f551b699640 1 Processor -- start 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.130+0000 7f551b699640 1 -- start start 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.130+0000 7f551b699640 10 monclient: init 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient: _add_conns ranks=[3,1,0,2,4] 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f55140a96e0 0x7f55141427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient(hunting): picked mon.noname-a con 0x7f55140a96e0 addr v2:172.21.15.116:3300/0 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7f55140a9ac0 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f551413fb30 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55140aa880 con 0x7f551413fb30 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55140aaad0 con 0x7f55140a9ac0 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:35.131 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 1 -- --> v2:172.21.15.116:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55140aadb0 con 0x7f55140a96e0 2024-01-23T08:10:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f551b699640 10 monclient(hunting): authenticate will time out at 4642.488497s 2024-01-23T08:10:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.131+0000 7f5519435640 1 --2- >> v2:172.21.15.116:3300/0 conn(0x7f55140a96e0 0x7f55141427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.132+0000 7f5518c34640 1 --1- >> v1:172.21.15.173:6789/0 conn(0x7f55140a9ac0 0x7f551413f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.173:6789/0 says I am v1:172.21.15.116:42204/0 (socket says 172.21.15.116:42204) 2024-01-23T08:10:35.132 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.132+0000 7f5518c34640 1 -- 172.21.15.116:0/1718954133 learned_addr learned my addr 172.21.15.116:0/1718954133 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:35.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.132+0000 7f5519435640 10 monclient(hunting): get_auth_request con 0x7f55140a96e0 auth_method 0 2024-01-23T08:10:35.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.132+0000 7f5519435640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:35.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.132+0000 7f5519435640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:35.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.132+0000 7f5519435640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:35.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.133+0000 7f5519435640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:35.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.133+0000 7f5519435640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:35.133 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.133+0000 7f5519435640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:35.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f550bfff640 1 -- 172.21.15.116:0/1718954133 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147743693 0 0) 0x7f55140aaad0 con 0x7f55140a9ac0 2024-01-23T08:10:35.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f550bfff640 10 monclient(hunting): _negotiate 2024-01-23T08:10:35.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f550bfff640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:35.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f550bfff640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:35.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f550bfff640 10 monclient(hunting): my global_id is 20992 2024-01-23T08:10:35.134 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f550bfff640 1 -- 172.21.15.116:0/1718954133 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5500003520 con 0x7f55140a9ac0 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 10 monclient(hunting): handle_auth_done global_id 16614 payload 274 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 1 -- 172.21.15.116:0/1718954133 >> v1:172.21.15.173:6789/0 conn(0x7f55140a9ac0 legacy=0x7f551413f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 1 -- 172.21.15.116:0/1718954133 >> v1:172.21.15.116:6789/0 conn(0x7f551413fb30 legacy=0x7f551414ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 10 monclient: _finish_hunting 0 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 1 monclient: found mon.noname-a 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:35.135 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.135+0000 7f5519435640 1 -- 172.21.15.116:0/1718954133 --> v2:172.21.15.116:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55140ab090 con 0x7f55140a96e0 2024-01-23T08:10:35.138 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.139+0000 7f5519435640 1 --2- 172.21.15.116:0/1718954133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55140a96e0 0x7f55141427e0 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 crypto rx=0x7f55100097a0 tx=0x7f551002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5206fc9749733ba server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.143+0000 7f550bfff640 1 -- 172.21.15.116:0/1718954133 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510030610 con 0x7f55140a96e0 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.143+0000 7f550bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: dump: 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:35.144 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: _finish_auth 0 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: _check_auth_tickets 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 1 -- 172.21.15.116:0/1718954133 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5510030770 con 0x7f55140a96e0 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 1 -- 172.21.15.116:0/1718954133 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510030b00 con 0x7f55140a96e0 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 5 monclient: authenticate success, global_id 16614 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:35.145 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 4 set_mon_vals no callback set 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f550bfff640 10 monclient: dump: 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.146 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 10 monclient: shutdown 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 1 -- 172.21.15.116:0/1718954133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55140a96e0 msgr2=0x7f55141427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 1 --2- 172.21.15.116:0/1718954133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55140a96e0 0x7f55141427e0 secure :-1 s=READY pgs=3261 cs=0 l=1 rev1=1 crypto rx=0x7f55100097a0 tx=0x7f551002b960 comp rx=0 tx=0).stop 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 1 -- 172.21.15.116:0/1718954133 shutdown_connections 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 1 --2- 172.21.15.116:0/1718954133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f55140a96e0 0x7f55141427e0 unknown :-1 s=CLOSED pgs=3261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 1 -- 172.21.15.116:0/1718954133 >> 172.21.15.116:0/1718954133 conn(0x7f55140b7bb0 msgr2=0x7f55140b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 1 -- 172.21.15.116:0/1718954133 shutdown_connections 2024-01-23T08:10:35.147 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.144+0000 7f551b699640 1 -- 172.21.15.116:0/1718954133 wait complete. 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.145+0000 7f551b699640 10 monclient: build_initial_monmap 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.145+0000 7f551b699640 10 monclient: monmap: 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:35.151 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 librados: starting msgr at 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 librados: starting objecter 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 Processor -- start 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 -- start start 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 librados: setting wanted keys 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 librados: calling monclient init 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient: init 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient: _add_conns ranks=[2,1,0] 2024-01-23T08:10:35.152 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 0x7f551413e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): picked mon.noname-c con 0x7f55140a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55140a9ac0 0x7f55141da770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): picked mon.noname-b con 0x7f55140a9ac0 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5514145460 0x7f55141dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): picked mon.noname-a con 0x7f5514145460 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55140abda0 con 0x7f5514145460 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5514145980 con 0x7f55140a9ac0 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55140abf80 con 0x7f55140a96e0 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.146+0000 7f551b699640 10 monclient(hunting): authenticate will time out at 4642.503937s 2024-01-23T08:10:35.153 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519c36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5514145460 0x7f55141dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 0x7f551413e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5518c34640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55140a9ac0 0x7f55141da770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519c36640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5514145460 0x7f55141dacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:34004/0 (socket says 172.21.15.116:34004) 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519c36640 1 -- 172.21.15.116:0/3618793302 learned_addr learned my addr 172.21.15.116:0/3618793302 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519c36640 10 monclient(hunting): get_auth_request con 0x7f5514145460 auth_method 0 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519c36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519c36640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519c36640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 10 monclient(hunting): get_auth_request con 0x7f55140a96e0 auth_method 0 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5518c34640 10 monclient(hunting): get_auth_request con 0x7f55140a9ac0 auth_method 0 2024-01-23T08:10:35.154 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5518c34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5518c34640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5518c34640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 1 -- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 msgr2=0x7f551413e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 1 -- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 msgr2=0x7f551413e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 0x7f551413e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.147+0000 7f5519435640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 0x7f551413e270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.148+0000 7f5519c36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.148+0000 7f5519c36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.148+0000 7f5519c36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.148+0000 7f5518c34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.148+0000 7f5518c34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.148+0000 7f5518c34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 10 monclient(hunting): handle_auth_done global_id 20995 payload 824 2024-01-23T08:10:35.155 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 1 -- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 msgr2=0x7f551413e270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 0x7f551413e270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 1 -- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5514145460 msgr2=0x7f55141dacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5514145460 0x7f55141dacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 10 monclient: _finish_hunting 0 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 1 monclient: found mon.noname-b 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.173:3300/0 2024-01-23T08:10:35.156 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.150+0000 7f5518c34640 1 -- 172.21.15.116:0/3618793302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510009400 con 0x7f55140a9ac0 2024-01-23T08:10:35.157 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.153+0000 7f5518c34640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55140a9ac0 0x7f55141da770 secure :-1 s=READY pgs=5234 cs=0 l=1 rev1=1 crypto rx=0x7f550400c430 tx=0x7f550400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.153+0000 7f5509ffb640 10 client.?.objecter ms_handle_connect 0x7f55140a9ac0 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.153+0000 7f5509ffb640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 1 -- 172.21.15.116:0/3618793302 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504005d30 con 0x7f55140a9ac0 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: dump: 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:35.158 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: _finish_auth 0 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: _check_auth_tickets 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 1 -- 172.21.15.116:0/3618793302 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5504005e90 con 0x7f55140a9ac0 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 1 -- 172.21.15.116:0/3618793302 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55040072f0 con 0x7f55140a9ac0 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f551b699640 5 monclient: authenticate success, global_id 20995 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f551b699640 10 monclient: _renew_subs 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f551b699640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5514145f30 con 0x7f55140a9ac0 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f550affd640 4 set_mon_vals no callback set 2024-01-23T08:10:35.159 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.156+0000 7f5509ffb640 10 monclient: dump: 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:35.160 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.157+0000 7f551b699640 10 client.20995.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.157+0000 7f551b699640 10 monclient: _renew_subs 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.157+0000 7f551b699640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.157+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55141450f0 con 0x7f55140a9ac0 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.157+0000 7f551b699640 1 librados: init done 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.158+0000 7f551b699640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.158+0000 7f551b699640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.158+0000 7f551b699640 10 monclient: _send_mon_message to mon.b at v2:172.21.15.173:3300/0 2024-01-23T08:10:35.161 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.158+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55140aa2c0 con 0x7f55140a9ac0 2024-01-23T08:10:35.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.400+0000 7f5509ffb640 1 -- 172.21.15.116:0/3618793302 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f5504007450 con 0x7f55140a9ac0 2024-01-23T08:10:35.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.401+0000 7f5509ffb640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f54f806c860 0x7f54f806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:35.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.401+0000 7f5519435640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f54f806c860 0x7f54f806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:35.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.401+0000 7f5519435640 10 monclient: get_auth_request con 0x7f54f806c860 auth_method 0 2024-01-23T08:10:35.400 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.401+0000 7f5509ffb640 10 client.20995.objecter ms_handle_connect 0x7f54f806c860 2024-01-23T08:10:35.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.401+0000 7f5519435640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f54f806c860 0x7f54f806ed20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5510036000 tx=0x7f5510008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:35.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.402+0000 7f5509ffb640 1 -- 172.21.15.116:0/3618793302 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f5504057b40 con 0x7f55140a9ac0 2024-01-23T08:10:35.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.402+0000 7f5509ffb640 10 client.20995.objecter ms_dispatch 0x7f5514000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:35.401 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.402+0000 7f5509ffb640 3 client.20995.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:35.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.402+0000 7f5509ffb640 3 client.20995.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:35.402 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.402+0000 7f5509ffb640 20 client.20995.objecter dump_active .. 0 homeless 2024-01-23T08:10:35.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.412+0000 7f5509ffb640 1 -- 172.21.15.116:0/3618793302 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f5504057680 con 0x7f55140a9ac0 2024-01-23T08:10:35.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.412+0000 7f5509ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:35.411 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.412+0000 7f5509ffb640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:35.577 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.578+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5514142d20 con 0x7f54f806c860 2024-01-23T08:10:35.581 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.582+0000 7f5509ffb640 1 -- 172.21.15.116:0/3618793302 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151388 (secure 0 0 0) 0x7f5510044480 con 0x7f54f806c860 2024-01-23T08:10:35.583 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T08:10:35.583 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-01-23T08:10:35.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 10 librados: watch_flush enter 2024-01-23T08:10:35.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 10 librados: watch_flush exit 2024-01-23T08:10:35.585 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 20 client.20995.objecter shutdown clearing up homeless session... 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 10 client.20995.objecter successfully canceled tick 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f54f806c860 msgr2=0x7f54f806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f54f806c860 0x7f54f806ed20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5510036000 tx=0x7f5510008030 comp rx=0 tx=0).stop 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 10 monclient: shutdown 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55140a9ac0 msgr2=0x7f55141da770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55140a9ac0 0x7f55141da770 secure :-1 s=READY pgs=5234 cs=0 l=1 rev1=1 crypto rx=0x7f550400c430 tx=0x7f550400c8f0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 shutdown_connections 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f54f806c860 0x7f54f806ed20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5514145460 0x7f55141dacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f55140a9ac0 0x7f55141da770 unknown :-1 s=CLOSED pgs=5234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 --2- 172.21.15.116:0/3618793302 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f55140a96e0 0x7f551413e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 >> 172.21.15.116:0/3618793302 conn(0x7f55140b7bb0 msgr2=0x7f55140b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:35.586 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 shutdown_connections 2024-01-23T08:10:35.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 -- 172.21.15.116:0/3618793302 wait complete. 2024-01-23T08:10:35.587 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:35.585+0000 7f551b699640 1 librados: shutdown 2024-01-23T08:10:35.595 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2446,"stamp":"2024-01-23T08:10:35.072153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":582140,"kb_used_data":39768,"kb_used_omap":12,"kb_used_meta":542259,"kb_avail":754392580,"statfs":{"total":773094113280,"available":772498001920,"internally_reserved":0,"allocated":40722432,"data_stored":19041170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":555273776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":72,"apply_latency_ms":72,"commit_latency_ns":72000000,"apply_latency_ns":72000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001742"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":2551,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.110997+0000","last_change":"2024-01-23T07:35:49.772956+0000","last_active":"2024-01-23T08:10:26.110997+0000","last_peered":"2024-01-23T08:10:26.110997+0000","last_clean":"2024-01-23T08:10:26.110997+0000","last_became_active":"2024-01-23T07:35:49.767110+0000","last_became_peered":"2024-01-23T07:35:49.767110+0000","last_unstale":"2024-01-23T08:10:26.110997+0000","last_undegraded":"2024-01-23T08:10:26.110997+0000","last_fullsized":"2024-01-23T08:10:26.110997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:11:19.875803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":2547,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.116384+0000","last_change":"2024-01-23T07:46:17.396184+0000","last_active":"2024-01-23T08:10:26.116384+0000","last_peered":"2024-01-23T08:10:26.116384+0000","last_clean":"2024-01-23T08:10:26.116384+0000","last_became_active":"2024-01-23T07:46:17.386551+0000","last_became_peered":"2024-01-23T07:46:17.386551+0000","last_unstale":"2024-01-23T08:10:26.116384+0000","last_undegraded":"2024-01-23T08:10:26.116384+0000","last_fullsized":"2024-01-23T08:10:26.116384+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:18:07.924980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":2071,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.838412+0000","last_change":"2024-01-23T07:40:37.949256+0000","last_active":"2024-01-23T08:10:25.838412+0000","last_peered":"2024-01-23T08:10:25.838412+0000","last_clean":"2024-01-23T08:10:25.838412+0000","last_became_active":"2024-01-23T07:40:37.943110+0000","last_became_peered":"2024-01-23T07:40:37.943110+0000","last_unstale":"2024-01-23T08:10:25.838412+0000","last_undegraded":"2024-01-23T08:10:25.838412+0000","last_fullsized":"2024-01-23T08:10:25.838412+0000","mapping_epoch":276,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":277,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":2538,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.096414+0000","last_change":"2024-01-23T07:35:17.672440+0000","last_active":"2024-01-23T08:10:26.096414+0000","last_peered":"2024-01-23T08:10:26.096414+0000","last_clean":"2024-01-23T08:10:26.096414+0000","last_became_active":"2024-01-23T07:35:17.664344+0000","last_became_peered":"2024-01-23T07:35:17.664344+0000","last_unstale":"2024-01-23T08:10:26.096414+0000","last_undegraded":"2024-01-23T08:10:26.096414+0000","last_fullsized":"2024-01-23T08:10:26.096414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:29:47.794690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":2536,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.077647+0000","last_change":"2024-01-23T07:35:53.501964+0000","last_active":"2024-01-23T08:10:26.077647+0000","last_peered":"2024-01-23T08:10:26.077647+0000","last_clean":"2024-01-23T08:10:26.077647+0000","last_became_active":"2024-01-23T07:35:53.492743+0000","last_became_peered":"2024-01-23T07:35:53.492743+0000","last_unstale":"2024-01-23T08:10:26.077647+0000","last_undegraded":"2024-01-23T08:10:26.077647+0000","last_fullsized":"2024-01-23T08:10:26.077647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:57:15.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":2540,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.091990+0000","last_change":"2024-01-23T07:46:16.359928+0000","last_active":"2024-01-23T08:10:26.091990+0000","last_peered":"2024-01-23T08:10:26.091990+0000","last_clean":"2024-01-23T08:10:26.091990+0000","last_became_active":"2024-01-23T07:46:16.353670+0000","last_became_peered":"2024-01-23T07:46:16.353670+0000","last_unstale":"2024-01-23T08:10:26.091990+0000","last_undegraded":"2024-01-23T08:10:26.091990+0000","last_fullsized":"2024-01-23T08:10:26.091990+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:55:34.799754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":2536,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.085407+0000","last_change":"2024-01-23T07:35:17.534265+0000","last_active":"2024-01-23T08:10:26.085407+0000","last_peered":"2024-01-23T08:10:26.085407+0000","last_clean":"2024-01-23T08:10:26.085407+0000","last_became_active":"2024-01-23T07:35:17.521909+0000","last_became_peered":"2024-01-23T07:35:17.521909+0000","last_unstale":"2024-01-23T08:10:26.085407+0000","last_undegraded":"2024-01-23T08:10:26.085407+0000","last_fullsized":"2024-01-23T08:10:26.085407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:42:31.245205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":2532,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.099878+0000","last_change":"2024-01-23T07:46:17.614578+0000","last_active":"2024-01-23T08:10:26.099878+0000","last_peered":"2024-01-23T08:10:26.099878+0000","last_clean":"2024-01-23T08:10:26.099878+0000","last_became_active":"2024-01-23T07:46:17.609277+0000","last_became_peered":"2024-01-23T07:46:17.609277+0000","last_unstale":"2024-01-23T08:10:26.099878+0000","last_undegraded":"2024-01-23T08:10:26.099878+0000","last_fullsized":"2024-01-23T08:10:26.099878+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:04:31.637396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":2536,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.087263+0000","last_change":"2024-01-23T07:35:17.515370+0000","last_active":"2024-01-23T08:10:26.087263+0000","last_peered":"2024-01-23T08:10:26.087263+0000","last_clean":"2024-01-23T08:10:26.087263+0000","last_became_active":"2024-01-23T07:35:17.510073+0000","last_became_peered":"2024-01-23T07:35:17.510073+0000","last_unstale":"2024-01-23T08:10:26.087263+0000","last_undegraded":"2024-01-23T08:10:26.087263+0000","last_fullsized":"2024-01-23T08:10:26.087263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:27:19.993768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":2533,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.103487+0000","last_change":"2024-01-23T07:35:53.382362+0000","last_active":"2024-01-23T08:10:26.103487+0000","last_peered":"2024-01-23T08:10:26.103487+0000","last_clean":"2024-01-23T08:10:26.103487+0000","last_became_active":"2024-01-23T07:35:53.376441+0000","last_became_peered":"2024-01-23T07:35:53.376441+0000","last_unstale":"2024-01-23T08:10:26.103487+0000","last_undegraded":"2024-01-23T08:10:26.103487+0000","last_fullsized":"2024-01-23T08:10:26.103487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:51:04.227769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":2562,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.840911+0000","last_change":"2024-01-23T07:35:26.286843+0000","last_active":"2024-01-23T08:10:25.840911+0000","last_peered":"2024-01-23T08:10:25.840911+0000","last_clean":"2024-01-23T08:10:25.840911+0000","last_became_active":"2024-01-23T07:35:26.273730+0000","last_became_peered":"2024-01-23T07:35:26.273730+0000","last_unstale":"2024-01-23T08:10:25.840911+0000","last_undegraded":"2024-01-23T08:10:25.840911+0000","last_fullsized":"2024-01-23T08:10:25.840911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":2527,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.087975+0000","last_change":"2024-01-23T07:36:02.469027+0000","last_active":"2024-01-23T08:10:26.087975+0000","last_peered":"2024-01-23T08:10:26.087975+0000","last_clean":"2024-01-23T08:10:26.087975+0000","last_became_active":"2024-01-23T07:36:02.460264+0000","last_became_peered":"2024-01-23T07:36:02.460264+0000","last_unstale":"2024-01-23T08:10:26.087975+0000","last_undegraded":"2024-01-23T08:10:26.087975+0000","last_fullsized":"2024-01-23T08:10:26.087975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"1323'78","reported_seq":2566,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:30.208237+0000","last_change":"2024-01-23T08:10:30.209607+0000","last_active":"2024-01-23T08:10:30.208237+0000","last_peered":"2024-01-23T08:10:30.208237+0000","last_clean":"2024-01-23T08:10:30.208237+0000","last_became_active":"2024-01-23T07:33:25.600297+0000","last_became_peered":"2024-01-23T07:33:25.600297+0000","last_unstale":"2024-01-23T08:10:30.208237+0000","last_undegraded":"2024-01-23T08:10:30.208237+0000","last_fullsized":"2024-01-23T08:10:30.208237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"1323'78","last_scrub_stamp":"2024-01-23T08:10:30.205620+0000","last_deep_scrub":"1323'78","last_deep_scrub_stamp":"2024-01-23T08:10:30.205620+0000","last_clean_scrub_stamp":"2024-01-23T08:10:30.205620+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:29:13.887875+0000","scrub_duration":125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2559,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.892511+0000","last_change":"2024-01-23T07:33:32.660913+0000","last_active":"2024-01-23T08:10:25.892511+0000","last_peered":"2024-01-23T08:10:25.892511+0000","last_clean":"2024-01-23T08:10:25.892511+0000","last_became_active":"2024-01-23T07:33:32.655848+0000","last_became_peered":"2024-01-23T07:33:32.655848+0000","last_unstale":"2024-01-23T08:10:25.892511+0000","last_undegraded":"2024-01-23T08:10:25.892511+0000","last_fullsized":"2024-01-23T08:10:25.892511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:09:57.469855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":2560,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.824891+0000","last_change":"2024-01-23T07:35:08.880758+0000","last_active":"2024-01-23T08:10:25.824891+0000","last_peered":"2024-01-23T08:10:25.824891+0000","last_clean":"2024-01-23T08:10:25.824891+0000","last_became_active":"2024-01-23T07:35:08.862294+0000","last_became_peered":"2024-01-23T07:35:08.862294+0000","last_unstale":"2024-01-23T08:10:25.824891+0000","last_undegraded":"2024-01-23T08:10:25.824891+0000","last_fullsized":"2024-01-23T08:10:25.824891+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2559,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.876444+0000","last_change":"2024-01-23T07:33:32.273001+0000","last_active":"2024-01-23T08:10:25.876444+0000","last_peered":"2024-01-23T08:10:25.876444+0000","last_clean":"2024-01-23T08:10:25.876444+0000","last_became_active":"2024-01-23T07:33:32.242199+0000","last_became_peered":"2024-01-23T07:33:32.242199+0000","last_unstale":"2024-01-23T08:10:25.876444+0000","last_undegraded":"2024-01-23T08:10:25.876444+0000","last_fullsized":"2024-01-23T08:10:25.876444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:00:09.885876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":2529,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.132430+0000","last_change":"2024-01-23T07:35:57.074880+0000","last_active":"2024-01-23T08:10:26.132430+0000","last_peered":"2024-01-23T08:10:26.132430+0000","last_clean":"2024-01-23T08:10:26.132430+0000","last_became_active":"2024-01-23T07:35:57.067585+0000","last_became_peered":"2024-01-23T07:35:57.067585+0000","last_unstale":"2024-01-23T08:10:26.132430+0000","last_undegraded":"2024-01-23T08:10:26.132430+0000","last_fullsized":"2024-01-23T08:10:26.132430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2553,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.106819+0000","last_change":"2024-01-23T07:46:17.828288+0000","last_active":"2024-01-23T08:10:26.106819+0000","last_peered":"2024-01-23T08:10:26.106819+0000","last_clean":"2024-01-23T08:10:26.106819+0000","last_became_active":"2024-01-23T07:46:17.822757+0000","last_became_peered":"2024-01-23T07:46:17.822757+0000","last_unstale":"2024-01-23T08:10:26.106819+0000","last_undegraded":"2024-01-23T08:10:26.106819+0000","last_fullsized":"2024-01-23T08:10:26.106819+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:16:46.198098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":2536,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.098175+0000","last_change":"2024-01-23T07:35:17.207540+0000","last_active":"2024-01-23T08:10:26.098175+0000","last_peered":"2024-01-23T08:10:26.098175+0000","last_clean":"2024-01-23T08:10:26.098175+0000","last_became_active":"2024-01-23T07:35:17.149780+0000","last_became_peered":"2024-01-23T07:35:17.149780+0000","last_unstale":"2024-01-23T08:10:26.098175+0000","last_undegraded":"2024-01-23T08:10:26.098175+0000","last_fullsized":"2024-01-23T08:10:26.098175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:36:31.573133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2559,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.888543+0000","last_change":"2024-01-23T07:33:32.478085+0000","last_active":"2024-01-23T08:10:25.888543+0000","last_peered":"2024-01-23T08:10:25.888543+0000","last_clean":"2024-01-23T08:10:25.888543+0000","last_became_active":"2024-01-23T07:33:32.468117+0000","last_became_peered":"2024-01-23T07:33:32.468117+0000","last_unstale":"2024-01-23T08:10:25.888543+0000","last_undegraded":"2024-01-23T08:10:25.888543+0000","last_fullsized":"2024-01-23T08:10:25.888543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:53:49.321585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":2566,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.830122+0000","last_change":"2024-01-23T07:46:17.171650+0000","last_active":"2024-01-23T08:10:25.830122+0000","last_peered":"2024-01-23T08:10:25.830122+0000","last_clean":"2024-01-23T08:10:25.830122+0000","last_became_active":"2024-01-23T07:46:17.164304+0000","last_became_peered":"2024-01-23T07:46:17.164304+0000","last_unstale":"2024-01-23T08:10:25.830122+0000","last_undegraded":"2024-01-23T08:10:25.830122+0000","last_fullsized":"2024-01-23T08:10:25.830122+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2571,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.827597+0000","last_change":"2024-01-23T07:33:32.481074+0000","last_active":"2024-01-23T08:10:25.827597+0000","last_peered":"2024-01-23T08:10:25.827597+0000","last_clean":"2024-01-23T08:10:25.827597+0000","last_became_active":"2024-01-23T07:33:32.474543+0000","last_became_peered":"2024-01-23T07:33:32.474543+0000","last_unstale":"2024-01-23T08:10:25.827597+0000","last_undegraded":"2024-01-23T08:10:25.827597+0000","last_fullsized":"2024-01-23T08:10:25.827597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":2550,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.105671+0000","last_change":"2024-01-23T07:35:28.743786+0000","last_active":"2024-01-23T08:10:26.105671+0000","last_peered":"2024-01-23T08:10:26.105671+0000","last_clean":"2024-01-23T08:10:26.105671+0000","last_became_active":"2024-01-23T07:35:28.738559+0000","last_became_peered":"2024-01-23T07:35:28.738559+0000","last_unstale":"2024-01-23T08:10:26.105671+0000","last_undegraded":"2024-01-23T08:10:26.105671+0000","last_fullsized":"2024-01-23T08:10:26.105671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:43:03.397366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2559,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.901728+0000","last_change":"2024-01-23T07:33:32.371113+0000","last_active":"2024-01-23T08:10:25.901728+0000","last_peered":"2024-01-23T08:10:25.901728+0000","last_clean":"2024-01-23T08:10:25.901728+0000","last_became_active":"2024-01-23T07:33:32.353826+0000","last_became_peered":"2024-01-23T07:33:32.353826+0000","last_unstale":"2024-01-23T08:10:25.901728+0000","last_undegraded":"2024-01-23T08:10:25.901728+0000","last_fullsized":"2024-01-23T08:10:25.901728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:16:09.518702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":2537,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.080550+0000","last_change":"2024-01-23T07:35:16.873946+0000","last_active":"2024-01-23T08:10:26.080550+0000","last_peered":"2024-01-23T08:10:26.080550+0000","last_clean":"2024-01-23T08:10:26.080550+0000","last_became_active":"2024-01-23T07:35:16.868129+0000","last_became_peered":"2024-01-23T07:35:16.868129+0000","last_unstale":"2024-01-23T08:10:26.080550+0000","last_undegraded":"2024-01-23T08:10:26.080550+0000","last_fullsized":"2024-01-23T08:10:26.080550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:02:37.157717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2559,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.117366+0000","last_change":"2024-01-23T07:33:32.719529+0000","last_active":"2024-01-23T08:10:26.117366+0000","last_peered":"2024-01-23T08:10:26.117366+0000","last_clean":"2024-01-23T08:10:26.117366+0000","last_became_active":"2024-01-23T07:33:32.693171+0000","last_became_peered":"2024-01-23T07:33:32.693171+0000","last_unstale":"2024-01-23T08:10:26.117366+0000","last_undegraded":"2024-01-23T08:10:26.117366+0000","last_fullsized":"2024-01-23T08:10:26.117366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:08:58.102768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":2537,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.075804+0000","last_change":"2024-01-23T07:35:17.021056+0000","last_active":"2024-01-23T08:10:26.075804+0000","last_peered":"2024-01-23T08:10:26.075804+0000","last_clean":"2024-01-23T08:10:26.075804+0000","last_became_active":"2024-01-23T07:35:17.011327+0000","last_became_peered":"2024-01-23T07:35:17.011327+0000","last_unstale":"2024-01-23T08:10:26.075804+0000","last_undegraded":"2024-01-23T08:10:26.075804+0000","last_fullsized":"2024-01-23T08:10:26.075804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:03:58.748267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2557,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.917418+0000","last_change":"2024-01-23T07:33:32.685400+0000","last_active":"2024-01-23T08:10:25.917418+0000","last_peered":"2024-01-23T08:10:25.917418+0000","last_clean":"2024-01-23T08:10:25.917418+0000","last_became_active":"2024-01-23T07:33:32.676672+0000","last_became_peered":"2024-01-23T07:33:32.676672+0000","last_unstale":"2024-01-23T08:10:25.917418+0000","last_undegraded":"2024-01-23T08:10:25.917418+0000","last_fullsized":"2024-01-23T08:10:25.917418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:33:30.731054+0000","last_clean_scrub_stamp":"2024-01-23T07:33:30.731054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:20:29.458030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":2537,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.090494+0000","last_change":"2024-01-23T07:35:17.450588+0000","last_active":"2024-01-23T08:10:26.090494+0000","last_peered":"2024-01-23T08:10:26.090494+0000","last_clean":"2024-01-23T08:10:26.090494+0000","last_became_active":"2024-01-23T07:35:17.445116+0000","last_became_peered":"2024-01-23T07:35:17.445116+0000","last_unstale":"2024-01-23T08:10:26.090494+0000","last_undegraded":"2024-01-23T08:10:26.090494+0000","last_fullsized":"2024-01-23T08:10:26.090494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:05:00.333834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":2558,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.819329+0000","last_change":"2024-01-23T07:35:23.296635+0000","last_active":"2024-01-23T08:10:25.819329+0000","last_peered":"2024-01-23T08:10:25.819329+0000","last_clean":"2024-01-23T08:10:25.819329+0000","last_became_active":"2024-01-23T07:35:23.240102+0000","last_became_peered":"2024-01-23T07:35:23.240102+0000","last_unstale":"2024-01-23T08:10:25.819329+0000","last_undegraded":"2024-01-23T08:10:25.819329+0000","last_fullsized":"2024-01-23T08:10:25.819329+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":2505,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.082618+0000","last_change":"2024-01-23T07:36:16.164085+0000","last_active":"2024-01-23T08:10:26.082618+0000","last_peered":"2024-01-23T08:10:26.082618+0000","last_clean":"2024-01-23T08:10:26.082618+0000","last_became_active":"2024-01-23T07:36:16.154523+0000","last_became_peered":"2024-01-23T07:36:16.154523+0000","last_unstale":"2024-01-23T08:10:26.082618+0000","last_undegraded":"2024-01-23T08:10:26.082618+0000","last_fullsized":"2024-01-23T08:10:26.082618+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:42:08.960329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":2539,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.093430+0000","last_change":"2024-01-23T07:35:53.515139+0000","last_active":"2024-01-23T08:10:26.093430+0000","last_peered":"2024-01-23T08:10:26.093430+0000","last_clean":"2024-01-23T08:10:26.093430+0000","last_became_active":"2024-01-23T07:35:53.509895+0000","last_became_peered":"2024-01-23T07:35:53.509895+0000","last_unstale":"2024-01-23T08:10:26.093430+0000","last_undegraded":"2024-01-23T08:10:26.093430+0000","last_fullsized":"2024-01-23T08:10:26.093430+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:27:03.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1","version":"115'7","reported_seq":2557,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:25.884136+0000","last_change":"2024-01-23T07:35:25.280614+0000","last_active":"2024-01-23T08:10:25.884136+0000","last_peered":"2024-01-23T08:10:25.884136+0000","last_clean":"2024-01-23T08:10:25.884136+0000","last_became_active":"2024-01-23T07:35:25.275034+0000","last_became_peered":"2024-01-23T07:35:25.275034+0000","last_unstale":"2024-01-23T08:10:25.884136+0000","last_undegraded":"2024-01-23T08:10:25.884136+0000","last_fullsized":"2024-01-23T08:10:25.884136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:49:35.214732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":2531,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.091211+0000","last_change":"2024-01-23T07:35:15.252226+0000","last_active":"2024-01-23T08:10:26.091211+0000","last_peered":"2024-01-23T08:10:26.091211+0000","last_clean":"2024-01-23T08:10:26.091211+0000","last_became_active":"2024-01-23T07:35:15.231845+0000","last_became_peered":"2024-01-23T07:35:15.231845+0000","last_unstale":"2024-01-23T08:10:26.091211+0000","last_undegraded":"2024-01-23T08:10:26.091211+0000","last_fullsized":"2024-01-23T08:10:26.091211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":2541,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.121347+0000","last_change":"2024-01-23T07:46:17.147281+0000","last_active":"2024-01-23T08:10:26.121347+0000","last_peered":"2024-01-23T08:10:26.121347+0000","last_clean":"2024-01-23T08:10:26.121347+0000","last_became_active":"2024-01-23T07:46:17.141733+0000","last_became_peered":"2024-01-23T07:46:17.141733+0000","last_unstale":"2024-01-23T08:10:26.121347+0000","last_undegraded":"2024-01-23T08:10:26.121347+0000","last_fullsized":"2024-01-23T08:10:26.121347+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:14:19.035625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":2532,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.082537+0000","last_change":"2024-01-23T07:35:11.695684+0000","last_active":"2024-01-23T08:10:26.082537+0000","last_peered":"2024-01-23T08:10:26.082537+0000","last_clean":"2024-01-23T08:10:26.082537+0000","last_became_active":"2024-01-23T07:35:11.686621+0000","last_became_peered":"2024-01-23T07:35:11.686621+0000","last_unstale":"2024-01-23T08:10:26.082537+0000","last_undegraded":"2024-01-23T08:10:26.082537+0000","last_fullsized":"2024-01-23T08:10:26.082537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":2534,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.098432+0000","last_change":"2024-01-23T07:35:52.897767+0000","last_active":"2024-01-23T08:10:26.098432+0000","last_peered":"2024-01-23T08:10:26.098432+0000","last_clean":"2024-01-23T08:10:26.098432+0000","last_became_active":"2024-01-23T07:35:52.882762+0000","last_became_peered":"2024-01-23T07:35:52.882762+0000","last_unstale":"2024-01-23T08:10:26.098432+0000","last_undegraded":"2024-01-23T08:10:26.098432+0000","last_fullsized":"2024-01-23T08:10:26.098432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:43:06.154174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":2534,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:29.823146+0000","last_change":"2024-01-23T08:10:29.823942+0000","last_active":"2024-01-23T08:10:29.823146+0000","last_peered":"2024-01-23T08:10:29.823146+0000","last_clean":"2024-01-23T08:10:29.823146+0000","last_became_active":"2024-01-23T07:35:31.935370+0000","last_became_peered":"2024-01-23T07:35:31.935370+0000","last_unstale":"2024-01-23T08:10:29.823146+0000","last_undegraded":"2024-01-23T08:10:29.823146+0000","last_fullsized":"2024-01-23T08:10:29.823146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:29.821811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:29.821811+0000","last_clean_scrub_stamp":"2024-01-23T08:10:29.821811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:59:40.413323+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":2542,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.112066+0000","last_change":"2024-01-23T07:46:17.160020+0000","last_active":"2024-01-23T08:10:26.112066+0000","last_peered":"2024-01-23T08:10:26.112066+0000","last_clean":"2024-01-23T08:10:26.112066+0000","last_became_active":"2024-01-23T07:46:17.153624+0000","last_became_peered":"2024-01-23T07:46:17.153624+0000","last_unstale":"2024-01-23T08:10:26.112066+0000","last_undegraded":"2024-01-23T08:10:26.112066+0000","last_fullsized":"2024-01-23T08:10:26.112066+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T07:45:27.942651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":2527,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.090233+0000","last_change":"2024-01-23T07:35:55.640548+0000","last_active":"2024-01-23T08:10:26.090233+0000","last_peered":"2024-01-23T08:10:26.090233+0000","last_clean":"2024-01-23T08:10:26.090233+0000","last_became_active":"2024-01-23T07:35:55.634625+0000","last_became_peered":"2024-01-23T07:35:55.634625+0000","last_unstale":"2024-01-23T08:10:26.090233+0000","last_undegraded":"2024-01-23T08:10:26.090233+0000","last_fullsized":"2024-01-23T08:10:26.090233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":2543,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:26.103671+0000","last_change":"2024-01-23T07:46:17.111555+0000","last_active":"2024-01-23T08:10:26.103671+0000","last_peered":"2024-01-23T08:10:26.103671+0000","last_clean":"2024-01-23T08:10:26.103671+0000","last_became_active":"2024-01-23T07:46:17.105960+0000","last_became_peered":"2024-01-23T07:46:17.105960+0000","last_unstale":"2024-01-23T08:10:26.103671+0000","last_undegraded":"2024-01-23T08:10:26.103671+0000","last_fullsized":"2024-01-23T08:10:26.103671+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T07:34:55.410736+0000","last_clean_scrub_stamp":"2024-01-23T07:34:55.410736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:36:28.032265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":19,"seq":81604379074,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72152,"kb_used_data":4876,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299688,"statfs":{"total":96636764160,"available":96562880512,"internally_reserved":0,"allocated":4993024,"data_stored":2280690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":13.061,"5min":24.649999999999999,"15min":18.510999999999999},"min":{"1min":4.6820000000000004,"5min":4.6390000000000002,"15min":4.4500000000000002},"max":{"1min":40.679000000000002,"5min":226.16999999999999,"15min":259.17200000000003},"last":23.759},{"interface":"front","average":{"1min":13.103,"5min":27.594000000000001,"15min":20.172000000000001},"min":{"1min":5.3700000000000001,"5min":4.5830000000000002,"15min":4.5800000000000001},"max":{"1min":32.253999999999998,"5min":335.11099999999999,"15min":335.11099999999999},"last":25.059000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":11.526999999999999,"5min":25.579000000000001,"15min":20.094999999999999},"min":{"1min":4.7089999999999996,"5min":4.7089999999999996,"15min":4.7089999999999996},"max":{"1min":35.301000000000002,"5min":202.30000000000001,"15min":202.30000000000001},"last":11.851000000000001},{"interface":"front","average":{"1min":17.094999999999999,"5min":27.420999999999999,"15min":23.341999999999999},"min":{"1min":7.7770000000000001,"5min":7.0030000000000001,"15min":6.8550000000000004},"max":{"1min":46.988999999999997,"5min":129.023,"15min":213.935},"last":18.082999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:10:18 2024","interfaces":[{"interface":"back","average":{"1min":17.052,"5min":41.604999999999997,"15min":31.245999999999999},"min":{"1min":7.8029999999999999,"5min":6.6710000000000003,"15min":6.5270000000000001},"max":{"1min":30.015999999999998,"5min":689.02099999999996,"15min":689.02099999999996},"last":18.975999999999999},{"interface":"front","average":{"1min":15.247999999999999,"5min":30.026,"15min":27.16},"min":{"1min":8.3960000000000008,"5min":6.556,"15min":6.556},"max":{"1min":26.483000000000001,"5min":363.96699999999998,"15min":386.762},"last":13.593999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":20.992999999999999,"5min":25.806999999999999,"15min":24.355},"min":{"1min":10.17,"5min":7.8150000000000004,"15min":7.8150000000000004},"max":{"1min":59.957000000000001,"5min":172.78299999999999,"15min":289.80599999999998},"last":12.154999999999999},{"interface":"front","average":{"1min":22.202999999999999,"5min":29.404,"15min":28.827999999999999},"min":{"1min":10.856999999999999,"5min":9.9879999999999995,"15min":9.5510000000000002},"max":{"1min":60.607999999999997,"5min":177.40000000000001,"15min":307.245},"last":14.379}]},{"osd":5,"last update":"Tue Jan 23 08:09:31 2024","interfaces":[{"interface":"back","average":{"1min":20.713000000000001,"5min":28.288,"15min":28.074000000000002},"min":{"1min":6.8029999999999999,"5min":6.8029999999999999,"15min":6.8029999999999999},"max":{"1min":44.375,"5min":201.06200000000001,"15min":359.69900000000001},"last":12.872999999999999},{"interface":"front","average":{"1min":23.881,"5min":28.484999999999999,"15min":28.401},"min":{"1min":12.388999999999999,"5min":10.301,"15min":9.407},"max":{"1min":79.674000000000007,"5min":149.059,"15min":334.642},"last":15.025}]},{"osd":6,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":23.018999999999998,"5min":32.515999999999998,"15min":32.387999999999998},"min":{"1min":10.845000000000001,"5min":8.4260000000000002,"15min":8.4260000000000002},"max":{"1min":73.620999999999995,"5min":199.66399999999999,"15min":341.05700000000002},"last":19.817},{"interface":"front","average":{"1min":29.157,"5min":34.218000000000004,"15min":29.725000000000001},"min":{"1min":15.654,"5min":11.496,"15min":6.6390000000000002},"max":{"1min":101.759,"5min":162.982,"15min":334.94600000000003},"last":16.875}]},{"osd":7,"last update":"Tue Jan 23 08:09:55 2024","interfaces":[{"interface":"back","average":{"1min":14.962999999999999,"5min":23.611000000000001,"15min":25.231000000000002},"min":{"1min":7.3460000000000001,"5min":7.298,"15min":7.2309999999999999},"max":{"1min":63.154000000000003,"5min":191.524,"15min":223.053},"last":7.9960000000000004},{"interface":"front","average":{"1min":25.978000000000002,"5min":33.332000000000001,"15min":25.420000000000002},"min":{"1min":9.9719999999999995,"5min":8.4459999999999997,"15min":6.9189999999999996},"max":{"1min":99.994,"5min":211.773,"15min":281.75299999999999},"last":16.239000000000001}]}]},{"osd":1,"up_from":19,"seq":81604379073,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72544,"kb_used_data":5264,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299296,"statfs":{"total":96636764160,"available":96562479104,"internally_reserved":0,"allocated":5390336,"data_stored":2678525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:26 2024","interfaces":[{"interface":"back","average":{"1min":16.315999999999999,"5min":22.128,"15min":19.146000000000001},"min":{"1min":6.4429999999999996,"5min":5.4100000000000001,"15min":5.4100000000000001},"max":{"1min":94.590999999999994,"5min":174.22800000000001,"15min":244.16},"last":7.1989999999999998},{"interface":"front","average":{"1min":22.446000000000002,"5min":28.849,"15min":27.295000000000002},"min":{"1min":10.259,"5min":6.7830000000000004,"15min":6.7830000000000004},"max":{"1min":97.444000000000003,"5min":198.155,"15min":247.33699999999999},"last":11.544}]},{"osd":2,"last update":"Tue Jan 23 08:09:32 2024","interfaces":[{"interface":"back","average":{"1min":15.324,"5min":25.154,"15min":25.584},"min":{"1min":8.266,"5min":8.266,"15min":6.2699999999999996},"max":{"1min":33.029000000000003,"5min":207.15100000000001,"15min":243.33000000000001},"last":14.085000000000001},{"interface":"front","average":{"1min":10.833,"5min":18.463000000000001,"15min":25.510999999999999},"min":{"1min":5.6710000000000003,"5min":4.915,"15min":4.915},"max":{"1min":19.279,"5min":167.71199999999999,"15min":366.99700000000001},"last":12.209}]},{"osd":3,"last update":"Tue Jan 23 08:09:46 2024","interfaces":[{"interface":"back","average":{"1min":21.405999999999999,"5min":28.048999999999999,"15min":23.024000000000001},"min":{"1min":8.6920000000000002,"5min":6.0270000000000001,"15min":5.3650000000000002},"max":{"1min":100.602,"5min":291.79300000000001,"15min":291.79300000000001},"last":10.622},{"interface":"front","average":{"1min":21.239000000000001,"5min":20.696000000000002,"15min":25.032},"min":{"1min":6.1360000000000001,"5min":5.3289999999999997,"15min":5.3289999999999997},"max":{"1min":88.227999999999994,"5min":221.50899999999999,"15min":398.98599999999999},"last":16.672999999999998}]},{"osd":4,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":23.504999999999999,"5min":30.498000000000001,"15min":32.963000000000001},"min":{"1min":11.525,"5min":8.2940000000000005,"15min":7.641},"max":{"1min":36.862000000000002,"5min":204.095,"15min":572.26999999999998},"last":19.725000000000001},{"interface":"front","average":{"1min":12.919,"5min":16.268999999999998,"15min":20.911000000000001},"min":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"max":{"1min":40.198,"5min":78.813000000000002,"15min":411.84399999999999},"last":9.6319999999999997}]},{"osd":5,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":29.154,"5min":28.667000000000002,"15min":31.228000000000002},"min":{"1min":7.6900000000000004,"5min":7.6900000000000004,"15min":7.6900000000000004},"max":{"1min":106.607,"5min":168.93000000000001,"15min":376.55700000000002},"last":12.848000000000001},{"interface":"front","average":{"1min":29.056000000000001,"5min":26.309999999999999,"15min":27.195},"min":{"1min":7.7670000000000003,"5min":7.7670000000000003,"15min":6.3959999999999999},"max":{"1min":91.256,"5min":173.46899999999999,"15min":364.32600000000002},"last":18.619}]},{"osd":6,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":25.513999999999999,"5min":31.672000000000001,"15min":34.091000000000001},"min":{"1min":15.657999999999999,"5min":10.664,"15min":10.664},"max":{"1min":53.466000000000001,"5min":174.54400000000001,"15min":377.375},"last":20.588000000000001},{"interface":"front","average":{"1min":22.515000000000001,"5min":26.417999999999999,"15min":26.864000000000001},"min":{"1min":9.1940000000000008,"5min":7.0590000000000002,"15min":7.0590000000000002},"max":{"1min":93.706999999999994,"5min":176.499,"15min":248.40000000000001},"last":14.842000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":21.986000000000001,"5min":26.722999999999999,"15min":22.699999999999999},"min":{"1min":9.6899999999999995,"5min":6.8049999999999997,"15min":6.8049999999999997},"max":{"1min":95.328000000000003,"5min":309.55900000000003,"15min":309.55900000000003},"last":16.346},{"interface":"front","average":{"1min":24.766999999999999,"5min":30.609999999999999,"15min":27.841000000000001},"min":{"1min":11.859999999999999,"5min":11.134,"15min":8.3670000000000009},"max":{"1min":98.653000000000006,"5min":169.82300000000001,"15min":245.946},"last":17.698}]}]},{"osd":4,"up_from":18,"seq":77309411778,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76320,"kb_used_data":4876,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295520,"statfs":{"total":96636764160,"available":96558612480,"internally_reserved":0,"allocated":4993024,"data_stored":2280690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":14.598000000000001,"5min":23.437999999999999,"15min":22.77},"min":{"1min":5.8570000000000002,"5min":5.2850000000000001,"15min":5.2850000000000001},"max":{"1min":98.227999999999994,"5min":371.233,"15min":371.233},"last":11.366},{"interface":"front","average":{"1min":18.530999999999999,"5min":24.696000000000002,"15min":25.018000000000001},"min":{"1min":7.8490000000000002,"5min":6.1909999999999998,"15min":5.9210000000000003},"max":{"1min":106.56699999999999,"5min":244.11199999999999,"15min":351.55700000000002},"last":14.887}]},{"osd":1,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":25.187000000000001,"5min":25.859999999999999,"15min":26.457999999999998},"min":{"1min":8.4510000000000005,"5min":6.3609999999999998,"15min":5.6040000000000001},"max":{"1min":147.08799999999999,"5min":260.22500000000002,"15min":353.72699999999998},"last":14.156000000000001},{"interface":"front","average":{"1min":28.363,"5min":33.558,"15min":32.466999999999999},"min":{"1min":12.493,"5min":10.728999999999999,"15min":7.5830000000000002},"max":{"1min":149.196,"5min":271.54700000000003,"15min":352.48700000000002},"last":16.079999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:10:30 2024","interfaces":[{"interface":"back","average":{"1min":10.343,"5min":48.07,"15min":29.359999999999999},"min":{"1min":5.234,"5min":4.6280000000000001,"15min":4.5800000000000001},"max":{"1min":20.648,"5min":2731.4580000000001,"15min":2731.4580000000001},"last":6.3630000000000004},{"interface":"front","average":{"1min":9.8219999999999992,"5min":42.253999999999998,"15min":26.823},"min":{"1min":6.2859999999999996,"5min":6.0810000000000004,"15min":4.6040000000000001},"max":{"1min":20.413,"5min":1368.422,"15min":1368.422},"last":12.007}]},{"osd":3,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":14.923,"5min":21.501000000000001,"15min":27.437000000000001},"min":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"max":{"1min":92.784999999999997,"5min":185.97900000000001,"15min":367.24000000000001},"last":8.1950000000000003},{"interface":"front","average":{"1min":21.876999999999999,"5min":30.088999999999999,"15min":28.812000000000001},"min":{"1min":12.944000000000001,"5min":10.311,"15min":6.4779999999999998},"max":{"1min":109.018,"5min":502.47000000000003,"15min":502.47000000000003},"last":12.222}]},{"osd":5,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":18.542000000000002,"5min":19.931000000000001,"15min":22.861999999999998},"min":{"1min":5.859,"5min":5.859,"15min":5.859},"max":{"1min":92.823999999999998,"5min":109.624,"15min":482.44299999999998},"last":9.2309999999999999},{"interface":"front","average":{"1min":20.876000000000001,"5min":25.094000000000001,"15min":23.469000000000001},"min":{"1min":8.7230000000000008,"5min":6.1280000000000001,"15min":5.3170000000000002},"max":{"1min":108.36499999999999,"5min":227.20500000000001,"15min":339.04300000000001},"last":13.317}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.561,"5min":25.599,"15min":28.395},"min":{"1min":9.6229999999999993,"5min":7.8109999999999999,"15min":7.8109999999999999},"max":{"1min":110.756,"5min":300.51999999999998,"15min":353.113},"last":7.274},{"interface":"front","average":{"1min":23.277000000000001,"5min":28.373000000000001,"15min":27.132000000000001},"min":{"1min":12.647,"5min":10.74,"15min":6.8090000000000002},"max":{"1min":109.562,"5min":208.05699999999999,"15min":349.64499999999998},"last":18.358000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":26.695,"5min":34.959000000000003,"15min":32.031999999999996},"min":{"1min":15.186,"5min":7.7939999999999996,"15min":7.3719999999999999},"max":{"1min":116.116,"5min":275.20999999999998,"15min":395.82299999999998},"last":17.158999999999999},{"interface":"front","average":{"1min":26.236000000000001,"5min":35.244,"15min":32.054000000000002},"min":{"1min":16.350999999999999,"5min":12.57,"15min":6.4859999999999998},"max":{"1min":124.672,"5min":184.47499999999999,"15min":438.92000000000002},"last":19.440999999999999}]}]},{"osd":7,"up_from":473,"seq":2031519531441,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72148,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299692,"statfs":{"total":96636764160,"available":96562884608,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":10.305999999999999,"5min":22.015000000000001,"15min":16.207999999999998},"min":{"1min":5.8280000000000003,"5min":5.6550000000000002,"15min":4.9550000000000001},"max":{"1min":24.335000000000001,"5min":282.28800000000001,"15min":282.28800000000001},"last":6.6680000000000001},{"interface":"front","average":{"1min":18.126999999999999,"5min":28.951000000000001,"15min":22.047000000000001},"min":{"1min":8.6720000000000006,"5min":7.4989999999999997,"15min":5.476},"max":{"1min":48.290999999999997,"5min":285.887,"15min":285.887},"last":13.865}]},{"osd":1,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":15.558999999999999,"5min":18.123999999999999,"15min":18.305},"min":{"1min":6.7359999999999998,"5min":4.8440000000000003,"15min":4.6509999999999998},"max":{"1min":74.322999999999993,"5min":162.80500000000001,"15min":199.09399999999999},"last":8.7409999999999997},{"interface":"front","average":{"1min":15.768000000000001,"5min":25.341999999999999,"15min":22.677},"min":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.1550000000000002},"max":{"1min":86.662000000000006,"5min":238.892,"15min":280.24299999999999},"last":7.9340000000000002}]},{"osd":2,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.838000000000001,"5min":37.078000000000003,"15min":25.183},"min":{"1min":10.106999999999999,"5min":6.8150000000000004,"15min":5.8129999999999997},"max":{"1min":38.683,"5min":1088.116,"15min":1088.116},"last":14.574},{"interface":"front","average":{"1min":14.474,"5min":35.444000000000003,"15min":25.821000000000002},"min":{"1min":8.9239999999999995,"5min":6.9080000000000004,"15min":5.2699999999999996},"max":{"1min":34.753,"5min":1187.3219999999999,"15min":1187.3219999999999},"last":18.224}]},{"osd":3,"last update":"Tue Jan 23 08:10:15 2024","interfaces":[{"interface":"back","average":{"1min":19.507000000000001,"5min":23.98,"15min":22.635999999999999},"min":{"1min":8.1560000000000006,"5min":7.7309999999999999,"15min":6.1749999999999998},"max":{"1min":65.203999999999994,"5min":177.09700000000001,"15min":313.31099999999998},"last":10.154999999999999},{"interface":"front","average":{"1min":24.954999999999998,"5min":25.353000000000002,"15min":23.792000000000002},"min":{"1min":9.6549999999999994,"5min":6.3029999999999999,"15min":6.3029999999999999},"max":{"1min":84.671999999999997,"5min":179.13999999999999,"15min":228.626},"last":10.795999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.268000000000001,"5min":25.036000000000001,"15min":23.661000000000001},"min":{"1min":7.444,"5min":6.5149999999999997,"15min":6.4850000000000003},"max":{"1min":64.384,"5min":206.381,"15min":277.70400000000001},"last":11.446999999999999},{"interface":"front","average":{"1min":19.050999999999998,"5min":24.832999999999998,"15min":23.053000000000001},"min":{"1min":10.968,"5min":7.7930000000000001,"15min":7.7930000000000001},"max":{"1min":34.298999999999999,"5min":186.768,"15min":320.26799999999997},"last":9.4380000000000006}]},{"osd":5,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":18.742999999999999,"5min":29.033999999999999,"15min":25.672999999999998},"min":{"1min":8.7370000000000001,"5min":8.6809999999999992,"15min":8.0350000000000001},"max":{"1min":29.145,"5min":323.63400000000001,"15min":323.63400000000001},"last":16.408000000000001},{"interface":"front","average":{"1min":20.257000000000001,"5min":29.279,"15min":26.036000000000001},"min":{"1min":6.5529999999999999,"5min":6.5529999999999999,"15min":6.5529999999999999},"max":{"1min":69.991,"5min":263.19799999999998,"15min":263.19799999999998},"last":15.192}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":16.844000000000001,"5min":26.978999999999999,"15min":25.648},"min":{"1min":8.0589999999999993,"5min":7.8849999999999998,"15min":7.1449999999999996},"max":{"1min":36.491,"5min":232.35599999999999,"15min":232.35599999999999},"last":12.032999999999999},{"interface":"front","average":{"1min":19.102,"5min":30.035,"15min":26.268000000000001},"min":{"1min":10.395,"5min":7.8029999999999999,"15min":7.4320000000000004},"max":{"1min":29.07,"5min":283.27800000000002,"15min":435.91899999999998},"last":17.305}]}]},{"osd":2,"up_from":16,"seq":68719477173,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72148,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299692,"statfs":{"total":96636764160,"available":96562884608,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":15.401999999999999,"5min":29.079000000000001,"15min":18.780000000000001},"min":{"1min":5.2670000000000003,"5min":3.9039999999999999,"15min":3.9039999999999999},"max":{"1min":103.72799999999999,"5min":1085.3969999999999,"15min":1085.3969999999999},"last":9.8940000000000001},{"interface":"front","average":{"1min":14.44,"5min":33.171999999999997,"15min":23.239999999999998},"min":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.5380000000000003},"max":{"1min":81.522999999999996,"5min":938.18899999999996,"15min":938.18899999999996},"last":6.1859999999999999}]},{"osd":1,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":13.436999999999999,"5min":23.271000000000001,"15min":21.917999999999999},"min":{"1min":7.5289999999999999,"5min":5.2000000000000002,"15min":5.0389999999999997},"max":{"1min":35.811,"5min":281.33499999999998,"15min":310.05200000000002},"last":8.1280000000000001},{"interface":"front","average":{"1min":17.768000000000001,"5min":39.762,"15min":31.893999999999998},"min":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":6.2220000000000004},"max":{"1min":71.415000000000006,"5min":969.31899999999996,"15min":969.31899999999996},"last":12.821999999999999}]},{"osd":3,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":15.061999999999999,"5min":36.173000000000002,"15min":27.225000000000001},"min":{"1min":8.5879999999999992,"5min":6.5270000000000001,"15min":5.9909999999999997},"max":{"1min":57.829999999999998,"5min":1096.0550000000001,"15min":1096.0550000000001},"last":12.478},{"interface":"front","average":{"1min":23.227,"5min":39.137999999999998,"15min":29.553999999999998},"min":{"1min":10.298999999999999,"5min":9.1189999999999998,"15min":8.1910000000000007},"max":{"1min":97.673000000000002,"5min":1097.8199999999999,"15min":1097.8199999999999},"last":19.288}]},{"osd":4,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":15.143000000000001,"5min":29.646999999999998,"15min":27.18},"min":{"1min":7.1609999999999996,"5min":7.1500000000000004,"15min":6.742},"max":{"1min":31.036000000000001,"5min":454.44299999999998,"15min":454.44299999999998},"last":7.1609999999999996},{"interface":"front","average":{"1min":18.111999999999998,"5min":35.648000000000003,"15min":28.036000000000001},"min":{"1min":11.343,"5min":8.423,"15min":7.5380000000000003},"max":{"1min":30.052,"5min":1087.472,"15min":1087.472},"last":17.100000000000001}]},{"osd":5,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":18.588999999999999,"5min":29.565000000000001,"15min":24.881},"min":{"1min":10.234999999999999,"5min":8.1760000000000002,"15min":8.0719999999999992},"max":{"1min":31.911999999999999,"5min":455.05500000000001,"15min":455.05500000000001},"last":11.792},{"interface":"front","average":{"1min":24.645,"5min":35.680999999999997,"15min":29.52},"min":{"1min":11.773,"5min":9.9220000000000006,"15min":9.1500000000000004},"max":{"1min":40.094999999999999,"5min":455.66699999999997,"15min":455.66699999999997},"last":15.000999999999999}]},{"osd":6,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":20.286000000000001,"5min":41.944000000000003,"15min":29.588999999999999},"min":{"1min":8.9420000000000002,"5min":7.6719999999999997,"15min":7.6719999999999997},"max":{"1min":79.620000000000005,"5min":977.35299999999995,"15min":977.35299999999995},"last":13.521000000000001},{"interface":"front","average":{"1min":26.472000000000001,"5min":46.683,"15min":32.813000000000002},"min":{"1min":12.85,"5min":9.0060000000000002,"15min":9.0060000000000002},"max":{"1min":89.191999999999993,"5min":982.83100000000002,"15min":982.83100000000002},"last":15.718}]},{"osd":7,"last update":"Tue Jan 23 08:10:04 2024","interfaces":[{"interface":"back","average":{"1min":27.013000000000002,"5min":50.5,"15min":33.725999999999999},"min":{"1min":11.968,"5min":10.092000000000001,"15min":8.9199999999999999},"max":{"1min":149.69399999999999,"5min":979.63699999999994,"15min":979.63699999999994},"last":14.285},{"interface":"front","average":{"1min":35.767000000000003,"5min":57.726999999999997,"15min":38.661000000000001},"min":{"1min":15.068,"5min":10.776999999999999,"15min":8.4049999999999994},"max":{"1min":156.78100000000001,"5min":984.54899999999998,"15min":984.54899999999998},"last":16.350000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542591,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72148,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299692,"statfs":{"total":96636764160,"available":96562884608,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":14.076000000000001,"5min":26.460000000000001,"15min":18.937999999999999},"min":{"1min":5.5800000000000001,"5min":5.4349999999999996,"15min":4.6289999999999996},"max":{"1min":58.256999999999998,"5min":240.86000000000001,"15min":259.21699999999998},"last":6.5780000000000003},{"interface":"front","average":{"1min":20.256,"5min":34.912999999999997,"15min":22.837},"min":{"1min":10.065,"5min":8.3789999999999996,"15min":4.3719999999999999},"max":{"1min":85.894000000000005,"5min":241.94999999999999,"15min":241.94999999999999},"last":8.843}]},{"osd":2,"last update":"Tue Jan 23 08:09:29 2024","interfaces":[{"interface":"back","average":{"1min":10.087999999999999,"5min":30.771999999999998,"15min":22.111000000000001},"min":{"1min":5.6349999999999998,"5min":5.6349999999999998,"15min":4.8499999999999996},"max":{"1min":22.939,"5min":272.22300000000001,"15min":272.22300000000001},"last":9.1460000000000008},{"interface":"front","average":{"1min":20.882000000000001,"5min":41.527000000000001,"15min":27.675000000000001},"min":{"1min":10.710000000000001,"5min":8.9939999999999998,"15min":5.8470000000000004},"max":{"1min":37.408999999999999,"5min":272.08100000000002,"15min":328.67500000000001},"last":10.537000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":20.913,"5min":32.823999999999998,"15min":23.902000000000001},"min":{"1min":9.9969999999999999,"5min":6.7539999999999996,"15min":6.7539999999999996},"max":{"1min":40.466999999999999,"5min":205.28700000000001,"15min":205.28700000000001},"last":13.762},{"interface":"front","average":{"1min":13.377000000000001,"5min":27.677,"15min":21.324000000000002},"min":{"1min":7.2839999999999998,"5min":6.2450000000000001,"15min":6.2450000000000001},"max":{"1min":41.201999999999998,"5min":205.19499999999999,"15min":205.19499999999999},"last":9.8960000000000008}]},{"osd":4,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.251999999999999,"5min":31.273,"15min":23.646000000000001},"min":{"1min":9.9580000000000002,"5min":7.835,"15min":6.6689999999999996},"max":{"1min":35.313000000000002,"5min":270.214,"15min":270.214},"last":11.138},{"interface":"front","average":{"1min":12.816000000000001,"5min":24.617000000000001,"15min":19.789999999999999},"min":{"1min":6.8490000000000002,"5min":6.4409999999999998,"15min":6.0579999999999998},"max":{"1min":27.478999999999999,"5min":206.066,"15min":206.066},"last":8.2680000000000007}]},{"osd":5,"last update":"Tue Jan 23 08:09:35 2024","interfaces":[{"interface":"back","average":{"1min":23.785,"5min":39.161000000000001,"15min":28.478000000000002},"min":{"1min":14.23,"5min":10.859,"15min":7.3689999999999998},"max":{"1min":83.944000000000003,"5min":266.38900000000001,"15min":269.887},"last":17.353999999999999},{"interface":"front","average":{"1min":17.472999999999999,"5min":25.440999999999999,"15min":22.010999999999999},"min":{"1min":8.0150000000000006,"5min":6.5090000000000003,"15min":5.431},"max":{"1min":76.481999999999999,"5min":267.16199999999998,"15min":267.16199999999998},"last":14.359}]},{"osd":6,"last update":"Tue Jan 23 08:09:42 2024","interfaces":[{"interface":"back","average":{"1min":18.571000000000002,"5min":35.337000000000003,"15min":28.390000000000001},"min":{"1min":8.4410000000000007,"5min":8.4410000000000007,"15min":8.2970000000000006},"max":{"1min":38.991,"5min":306.05900000000003,"15min":306.05900000000003},"last":11.914999999999999},{"interface":"front","average":{"1min":16.009,"5min":29.239000000000001,"15min":25.030000000000001},"min":{"1min":7.5499999999999998,"5min":7.2149999999999999,"15min":7.2149999999999999},"max":{"1min":38.191000000000003,"5min":235.76599999999999,"15min":235.76599999999999},"last":15.478}]},{"osd":7,"last update":"Tue Jan 23 08:10:00 2024","interfaces":[{"interface":"back","average":{"1min":22.579999999999998,"5min":41,"15min":28.344999999999999},"min":{"1min":15.906000000000001,"5min":12.061,"15min":6.9009999999999998},"max":{"1min":39.82,"5min":234.15700000000001,"15min":234.15700000000001},"last":18.135000000000002},{"interface":"front","average":{"1min":16.991,"5min":31.675999999999998,"15min":25.094999999999999},"min":{"1min":9.718,"5min":8.4979999999999993,"15min":6.6929999999999996},"max":{"1min":30.414999999999999,"5min":239.101,"15min":246.71799999999999},"last":16.274999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72144,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299696,"statfs":{"total":96636764160,"available":96562888704,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.843,"5min":21.023,"15min":20.405999999999999},"min":{"1min":6.4370000000000003,"5min":5.6959999999999997,"15min":4.5039999999999996},"max":{"1min":27.398,"5min":168.251,"15min":312.25599999999997},"last":10.56},{"interface":"front","average":{"1min":16.335999999999999,"5min":31.129999999999999,"15min":26.777000000000001},"min":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":5.2380000000000004},"max":{"1min":30.542000000000002,"5min":253.14500000000001,"15min":312.85199999999998},"last":11.183999999999999}]},{"osd":1,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.454999999999998,"5min":20.600000000000001,"15min":21.294},"min":{"1min":6.4470000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"max":{"1min":72.905000000000001,"5min":174.38800000000001,"15min":310.94200000000001},"last":17.306999999999999},{"interface":"front","average":{"1min":11.943,"5min":19.451000000000001,"15min":24.952999999999999},"min":{"1min":6.5999999999999996,"5min":5.8339999999999996,"15min":5.8339999999999996},"max":{"1min":40.143999999999998,"5min":208.99199999999999,"15min":285.43599999999998},"last":15.599}]},{"osd":2,"last update":"Tue Jan 23 08:10:22 2024","interfaces":[{"interface":"back","average":{"1min":15.574,"5min":44.034999999999997,"15min":27.588000000000001},"min":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"max":{"1min":73.838999999999999,"5min":1676.316,"15min":1676.316},"last":6.5880000000000001},{"interface":"front","average":{"1min":20.335999999999999,"5min":48.231999999999999,"15min":32.299999999999997},"min":{"1min":10.959,"5min":6.6260000000000003,"15min":6.6260000000000003},"max":{"1min":75.010000000000005,"5min":1582.598,"15min":1582.598},"last":13.646000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.201000000000001,"5min":25.422000000000001,"15min":24.648},"min":{"1min":10.119999999999999,"5min":10.119999999999999,"15min":7.8049999999999997},"max":{"1min":33.652000000000001,"5min":138.828,"15min":311.21300000000002},"last":19.818000000000001},{"interface":"front","average":{"1min":20.939,"5min":27.923999999999999,"15min":28.23},"min":{"1min":12.728999999999999,"5min":10.895,"15min":10.42},"max":{"1min":34.484999999999999,"5min":180.071,"15min":313.44200000000001},"last":18.901}]},{"osd":4,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.15,"5min":17.157,"15min":17.864000000000001},"min":{"1min":5.282,"5min":5.2320000000000002,"15min":5.2320000000000002},"max":{"1min":31.683,"5min":163.13399999999999,"15min":355.80000000000001},"last":7.3300000000000001},{"interface":"front","average":{"1min":16.738,"5min":23.565000000000001,"15min":23.312000000000001},"min":{"1min":9.1180000000000003,"5min":6.9829999999999997,"15min":6.9829999999999997},"max":{"1min":29.797999999999998,"5min":172.30799999999999,"15min":331.42500000000001},"last":11.609}]},{"osd":5,"last update":"Tue Jan 23 08:09:39 2024","interfaces":[{"interface":"back","average":{"1min":23.756,"5min":28.641999999999999,"15min":26.856000000000002},"min":{"1min":8.8849999999999998,"5min":8.5679999999999996,"15min":7.8380000000000001},"max":{"1min":63.781999999999996,"5min":248.00899999999999,"15min":259.23200000000003},"last":14.359999999999999},{"interface":"front","average":{"1min":28.175000000000001,"5min":34.142000000000003,"15min":31.850999999999999},"min":{"1min":15.789999999999999,"5min":9.7319999999999993,"15min":9.7319999999999993},"max":{"1min":79.778999999999996,"5min":249.30099999999999,"15min":278.38400000000001},"last":14.965999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:17 2024","interfaces":[{"interface":"back","average":{"1min":12.960000000000001,"5min":20.105,"15min":21.783999999999999},"min":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1769999999999996},"max":{"1min":38.274000000000001,"5min":167.12100000000001,"15min":343.786},"last":9.673},{"interface":"front","average":{"1min":20.988,"5min":31.399999999999999,"15min":29.193999999999999},"min":{"1min":10.363,"5min":10.363,"15min":10.363},"max":{"1min":68.890000000000001,"5min":186.30199999999999,"15min":302.589},"last":12.986000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575297,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72536,"kb_used_data":5264,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299304,"statfs":{"total":96636764160,"available":96562487296,"internally_reserved":0,"allocated":5390336,"data_stored":2678525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":11.755000000000001,"5min":15.83,"15min":17.065000000000001},"min":{"1min":5.0640000000000001,"5min":4.3899999999999997,"15min":4.3849999999999998},"max":{"1min":31.181000000000001,"5min":107.895,"15min":301.08300000000003},"last":8.0950000000000006},{"interface":"front","average":{"1min":13.680999999999999,"5min":15.866,"15min":18.422000000000001},"min":{"1min":6.8079999999999998,"5min":4.46,"15min":4.46},"max":{"1min":44.594000000000001,"5min":112.321,"15min":299.28699999999998},"last":10.381}]},{"osd":1,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":18.789999999999999,"5min":16.811,"15min":21.641999999999999},"min":{"1min":7.4450000000000003,"5min":6.0640000000000001,"15min":6.0640000000000001},"max":{"1min":48.829999999999998,"5min":108.367,"15min":335.601},"last":19.404},{"interface":"front","average":{"1min":15.991,"5min":15.215999999999999,"15min":18.478000000000002},"min":{"1min":6.2990000000000004,"5min":6.2990000000000004,"15min":5.9269999999999996},"max":{"1min":35.363,"5min":95.385000000000005,"15min":338.95499999999998},"last":20.486999999999998}]},{"osd":2,"last update":"Tue Jan 23 08:10:20 2024","interfaces":[{"interface":"back","average":{"1min":15.198,"5min":20.091999999999999,"15min":22.443000000000001},"min":{"1min":6.915,"5min":6.3940000000000001,"15min":6.2859999999999996},"max":{"1min":39.262999999999998,"5min":122.42700000000001,"15min":280.85399999999998},"last":8.8559999999999999},{"interface":"front","average":{"1min":15.127000000000001,"5min":20.622,"15min":23.937999999999999},"min":{"1min":7,"5min":6.7720000000000002,"15min":6.7720000000000002},"max":{"1min":66.775000000000006,"5min":268.779,"15min":307.334},"last":15.640000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":16.997,"5min":19.888999999999999,"15min":27.268000000000001},"min":{"1min":7.5330000000000004,"5min":7.2489999999999997,"15min":7.2489999999999997},"max":{"1min":34.234000000000002,"5min":108.986,"15min":412.625},"last":17.280999999999999},{"interface":"front","average":{"1min":16.832000000000001,"5min":20.248000000000001,"15min":25.879999999999999},"min":{"1min":7.306,"5min":7.306,"15min":7.1660000000000004},"max":{"1min":46.414999999999999,"5min":115.22499999999999,"15min":253.58199999999999},"last":12.657999999999999}]},{"osd":4,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":20.035,"5min":20.260000000000002,"15min":23.454999999999998},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":60.408000000000001,"5min":126.482,"15min":224.07400000000001},"last":9.7210000000000001},{"interface":"front","average":{"1min":24.856999999999999,"5min":24.849,"15min":27.280999999999999},"min":{"1min":11.863,"5min":9.5809999999999995,"15min":9.5809999999999995},"max":{"1min":68.748000000000005,"5min":175.51599999999999,"15min":281.10399999999998},"last":16.632000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:09:36 2024","interfaces":[{"interface":"back","average":{"1min":15.853,"5min":18.908999999999999,"15min":22.780999999999999},"min":{"1min":8.4540000000000006,"5min":7.5039999999999996,"15min":7.1130000000000004},"max":{"1min":36.344999999999999,"5min":141.524,"15min":338.66300000000001},"last":11.663},{"interface":"front","average":{"1min":22.779,"5min":24.696999999999999,"15min":28.998999999999999},"min":{"1min":13.907999999999999,"5min":11.093,"15min":10.342000000000001},"max":{"1min":72.058000000000007,"5min":145.38300000000001,"15min":417.69},"last":10.988}]},{"osd":7,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":25.297000000000001,"5min":23.457999999999998,"15min":22.731000000000002},"min":{"1min":12.375,"5min":9.8699999999999992,"15min":7.5039999999999996},"max":{"1min":103.679,"5min":111.083,"15min":244.40100000000001},"last":13.596},{"interface":"front","average":{"1min":18.907,"5min":20.039000000000001,"15min":21.625},"min":{"1min":6.3700000000000001,"5min":6.3700000000000001,"15min":6.3700000000000001},"max":{"1min":67.561000000000007,"5min":112.648,"15min":252.24000000000001},"last":17.969000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:10:35.600 INFO:tasks.ceph:pgid 21.5 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.4 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.7 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.6 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.19 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.18 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.1b last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.1a last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.601 INFO:tasks.ceph:pgid 21.1d last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 21.1c last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 21.1f last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 21.1e last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 21.14 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 21.17 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.602 INFO:tasks.ceph:pgid 21.16 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 21.15 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 21.13 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 21.12 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 21.11 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-01-23T07:33:30.731054+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=33, tm_sec=30, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.603 INFO:tasks.ceph:pgid 21.10 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.2 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.3 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.0 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.1 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.e last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.f last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.c last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.d last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.604 INFO:tasks.ceph:pgid 21.b last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.605 INFO:tasks.ceph:pgid 21.8 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.605 INFO:tasks.ceph:pgid 21.9 last_scrub_stamp 2024-01-23T07:34:55.410736+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=7, tm_min=34, tm_sec=55, tm_wday=1, tm_yday=23, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=23, tm_hour=8, tm_min=10, tm_sec=26, tm_wday=1, tm_yday=23, tm_isdst=0) 2024-01-23T08:10:35.605 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-23T08:10:41.295 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:29.674 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.299 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:29.679 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.319 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:29.698 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.351 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:29.684 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.352 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:29.686 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.366 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:29.746 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.368 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:29.704 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.369 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:29.749 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:41.389 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:29.769 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.875 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:34.255 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.878 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:34.258 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.894 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:34.274 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.925 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:34.261 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.928 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:34.264 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.928 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:34.308 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.930 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:34.310 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.939 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:34.275 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:45.942 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:34.322 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.863 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:39.243 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.865 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:39.245 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.877 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:39.257 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.917 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:39.297 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.918 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:39.254 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.919 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:39.299 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.921 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:39.258 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.932 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:39.312 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:50.934 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:39.270 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:10:55.606 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-23T08:10:55.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.707+0000 7f1c57b8e640 10 monclient: get_monmap_and_config 2024-01-23T08:10:55.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.707+0000 7f1c57b8e640 10 monclient: build_initial_monmap 2024-01-23T08:10:55.707 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.707+0000 7f1c57b8e640 10 monclient: monmap: 2024-01-23T08:10:55.707 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:55.707 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:55.707 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:55.708514+0000 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:55.708514+0000 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:55.708 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:55.710 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.707+0000 7f1c57b8e640 1 Processor -- start 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 1 -- start start 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient: init 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient: _add_conns ranks=[0,2,4,1,3] 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1c500a96e0 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c5013faa0 0x7f1c500b1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient(hunting): picked mon.noname-b con 0x7f1c5013faa0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 1 --2- >> v2:172.21.15.173:3300/0 conn(0x7f1c50145600 0x7f1c50145a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient(hunting): picked mon.noname-c con 0x7f1c50145600 addr v2:172.21.15.173:3300/0 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c500aac10 con 0x7f1c500a96e0 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 1 -- --> v2:172.21.15.173:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c500a9e00 con 0x7f1c50145600 2024-01-23T08:10:55.711 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c500a9ac0 con 0x7f1c5013faa0 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.708+0000 7f1c57b8e640 10 monclient(hunting): authenticate will time out at 4663.066938s 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c5592a640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7f1c500a96e0 0x7f1c5013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:52826/0 (socket says 172.21.15.116:52826) 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c5592a640 1 -- 172.21.15.116:0/2700087534 learned_addr learned my addr 172.21.15.116:0/2700087534 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c55129640 1 --2- 172.21.15.116:0/2700087534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c5013faa0 0x7f1c500b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c5612b640 1 --2- 172.21.15.116:0/2700087534 >> v2:172.21.15.173:3300/0 conn(0x7f1c50145600 0x7f1c50145a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c55129640 10 monclient(hunting): get_auth_request con 0x7f1c5013faa0 auth_method 0 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c55129640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c55129640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c55129640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c5612b640 10 monclient(hunting): get_auth_request con 0x7f1c50145600 auth_method 0 2024-01-23T08:10:55.712 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c5612b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c5612b640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.709+0000 7f1c5612b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.710+0000 7f1c55129640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.710+0000 7f1c55129640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.710+0000 7f1c55129640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.710+0000 7f1c5612b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.710+0000 7f1c5612b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:55.713 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.710+0000 7f1c5612b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:55.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c54928640 1 -- 172.21.15.116:0/2700087534 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128997931 0 0) 0x7f1c500aac10 con 0x7f1c500a96e0 2024-01-23T08:10:55.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c54928640 10 monclient(hunting): _negotiate 2024-01-23T08:10:55.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c54928640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:55.714 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c54928640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c54928640 10 monclient(hunting): my global_id is 16623 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c54928640 1 -- 172.21.15.116:0/2700087534 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c38003520 con 0x7f1c500a96e0 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 10 monclient(hunting): handle_auth_done global_id 28496 payload 274 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 1 -- 172.21.15.116:0/2700087534 >> v2:172.21.15.173:3300/0 conn(0x7f1c50145600 msgr2=0x7f1c50145a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 1 --2- 172.21.15.116:0/2700087534 >> v2:172.21.15.173:3300/0 conn(0x7f1c50145600 0x7f1c50145a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 1 -- 172.21.15.116:0/2700087534 >> v1:172.21.15.116:6789/0 conn(0x7f1c500a96e0 legacy=0x7f1c5013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 10 monclient: _finish_hunting 0 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 1 monclient: found mon.noname-b 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.711+0000 7f1c55129640 1 -- 172.21.15.116:0/2700087534 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c500aae80 con 0x7f1c5013faa0 2024-01-23T08:10:55.715 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.713+0000 7f1c55129640 1 --2- 172.21.15.116:0/2700087534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c5013faa0 0x7f1c500b1850 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009790 tx=0x7f1c4402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a4a1012bfa31d95 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 1 -- 172.21.15.116:0/2700087534 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44031800 con 0x7f1c5013faa0 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: dump: 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.718 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: _finish_auth 0 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: _check_auth_tickets 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 1 -- 172.21.15.116:0/2700087534 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c44031960 con 0x7f1c5013faa0 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c57b8e640 5 monclient: authenticate success, global_id 28496 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c57b8e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c57b8e640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:55.719 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 1 -- 172.21.15.116:0/2700087534 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44031cf0 con 0x7f1c5013faa0 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c57b8e640 4 set_mon_vals no callback set 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.717+0000 7f1c54928640 10 monclient: dump: 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:55.720 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 10 monclient: shutdown 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 -- 172.21.15.116:0/2700087534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c5013faa0 msgr2=0x7f1c500b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/2700087534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c5013faa0 0x7f1c500b1850 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 crypto rx=0x7f1c44009790 tx=0x7f1c4402b8a0 comp rx=0 tx=0).stop 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 -- 172.21.15.116:0/2700087534 shutdown_connections 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/2700087534 >> v2:172.21.15.173:3300/0 conn(0x7f1c50145600 0x7f1c50145a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/2700087534 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c5013faa0 0x7f1c500b1850 unknown :-1 s=CLOSED pgs=3336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 -- 172.21.15.116:0/2700087534 >> 172.21.15.116:0/2700087534 conn(0x7f1c500b7bb0 msgr2=0x7f1c500b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 -- 172.21.15.116:0/2700087534 shutdown_connections 2024-01-23T08:10:55.721 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 1 -- 172.21.15.116:0/2700087534 wait complete. 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.718+0000 7f1c57b8e640 10 monclient: build_initial_monmap 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 10 monclient: monmap: 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:55.725 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 1 librados: starting msgr at 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 1 librados: starting objecter 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 1 Processor -- start 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 1 -- start start 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 1 librados: setting wanted keys 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 1 librados: calling monclient init 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.719+0000 7f1c57b8e640 10 monclient: init 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient: _add_conns ranks=[2,0,1] 2024-01-23T08:10:55.726 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c500a96e0 0x7f1c500b7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): picked mon.noname-c con 0x7f1c500a96e0 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c5013faa0 0x7f1c5013bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): picked mon.noname-a con 0x7f1c5013faa0 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50145600 0x7f1c50138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): picked mon.noname-b con 0x7f1c50145600 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50138580 con 0x7f1c5013faa0 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5013c370 con 0x7f1c50145600 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c50137940 con 0x7f1c500a96e0 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c57b8e640 10 monclient(hunting): authenticate will time out at 4663.078431s 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c55129640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c5013faa0 0x7f1c5013bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:55.727 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c5592a640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c500a96e0 0x7f1c500b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c55129640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c5013faa0 0x7f1c5013bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37210/0 (socket says 172.21.15.116:37210) 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c55129640 1 -- 172.21.15.116:0/3868638554 learned_addr learned my addr 172.21.15.116:0/3868638554 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c55129640 10 monclient(hunting): get_auth_request con 0x7f1c5013faa0 auth_method 0 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.720+0000 7f1c55129640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c55129640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c55129640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5612b640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50145600 0x7f1c50138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5592a640 10 monclient(hunting): get_auth_request con 0x7f1c500a96e0 auth_method 0 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5592a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5592a640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5592a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c55129640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c55129640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c55129640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:55.728 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5612b640 10 monclient(hunting): get_auth_request con 0x7f1c50145600 auth_method 0 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5612b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5612b640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5612b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5592a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5592a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.721+0000 7f1c5592a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.722+0000 7f1c5612b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.722+0000 7f1c5612b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.722+0000 7f1c5612b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 10 monclient(hunting): handle_auth_done global_id 16626 payload 824 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 1 -- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c500a96e0 msgr2=0x7f1c500b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c500a96e0 0x7f1c500b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 1 -- 172.21.15.116:0/3868638554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50145600 msgr2=0x7f1c50138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50145600 0x7f1c50138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:55.729 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 10 monclient: _finish_hunting 0 2024-01-23T08:10:55.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 1 monclient: found mon.noname-a 2024-01-23T08:10:55.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:55.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.116:3300/0 2024-01-23T08:10:55.730 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.724+0000 7f1c55129640 1 -- 172.21.15.116:0/3868638554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440093a0 con 0x7f1c5013faa0 2024-01-23T08:10:55.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.726+0000 7f1c55129640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c5013faa0 0x7f1c5013bcb0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7f1c4402beb0 tx=0x7f1c440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:55.731 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.726+0000 7f1c4e7fc640 10 client.?.objecter ms_handle_connect 0x7f1c5013faa0 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.726+0000 7f1c4e7fc640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 1 -- 172.21.15.116:0/3868638554 <== mon.0 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4403bbf0 con 0x7f1c5013faa0 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: dump: 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:55.732 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: _finish_auth 0 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: _check_auth_tickets 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 1 -- 172.21.15.116:0/3868638554 <== mon.0 v2:172.21.15.116:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4403bd70 con 0x7f1c5013faa0 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 5 monclient: authenticate success, global_id 16626 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 10 monclient: _renew_subs 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c50136a70 con 0x7f1c5013faa0 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 1 -- 172.21.15.116:0/3868638554 <== mon.0 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c44045630 con 0x7f1c5013faa0 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:55.733 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4e7fc640 10 monclient: dump: 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c4ffff640 4 set_mon_vals no callback set 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 10 client.16626.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 10 monclient: _renew_subs 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c50136300 con 0x7f1c5013faa0 2024-01-23T08:10:55.734 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.730+0000 7f1c57b8e640 1 librados: init done 2024-01-23T08:10:55.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.731+0000 7f1c57b8e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:55.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.731+0000 7f1c57b8e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:55.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.731+0000 7f1c57b8e640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.116:3300/0 2024-01-23T08:10:55.735 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.731+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c50067d70 con 0x7f1c5013faa0 2024-01-23T08:10:55.749 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.750+0000 7f1c4e7fc640 1 -- 172.21.15.116:0/3868638554 <== mon.0 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7f1c4404e450 con 0x7f1c5013faa0 2024-01-23T08:10:55.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.750+0000 7f1c4e7fc640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f1c3c06c8b0 0x7f1c3c06ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:55.750 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.750+0000 7f1c5592a640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f1c3c06c8b0 0x7f1c3c06ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:55.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.750+0000 7f1c5592a640 10 monclient: get_auth_request con 0x7f1c3c06c8b0 auth_method 0 2024-01-23T08:10:55.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.750+0000 7f1c5592a640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f1c3c06c8b0 0x7f1c3c06ed70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1c48005c00 tx=0x7f1c48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:55.751 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.750+0000 7f1c4e7fc640 10 client.16626.objecter ms_handle_connect 0x7f1c3c06c8b0 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 1 -- 172.21.15.116:0/3868638554 <== mon.0 v2:172.21.15.116:3300/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7f1c4402e070 con 0x7f1c5013faa0 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 10 client.16626.objecter ms_dispatch 0x7f1c50000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 3 client.16626.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 3 client.16626.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 20 client.16626.objecter dump_active .. 0 homeless 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 1 -- 172.21.15.116:0/3868638554 <== mon.0 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7f1c44076b50 con 0x7f1c5013faa0 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:55.994 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:55.993+0000 7f1c4e7fc640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:56.170 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.170+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 --> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c50137ab0 con 0x7f1c3c06c8b0 2024-01-23T08:10:56.174 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.174+0000 7f1c4e7fc640 1 -- 172.21.15.116:0/3868638554 <== mgr.4113 v2:172.21.15.116:6800/2950757295 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+151522 (secure 0 0 0) 0x7f1c50137ab0 con 0x7f1c3c06c8b0 2024-01-23T08:10:56.176 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-23T08:10:56.177 INFO:teuthology.orchestra.run.smithi116.stderr:dumped all 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 10 librados: watch_flush enter 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 10 librados: watch_flush exit 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 20 client.16626.objecter shutdown clearing up homeless session... 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 10 client.16626.objecter successfully canceled tick 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f1c3c06c8b0 msgr2=0x7f1c3c06ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f1c3c06c8b0 0x7f1c3c06ed70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1c48005c00 tx=0x7f1c48009040 comp rx=0 tx=0).stop 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 10 monclient: shutdown 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:56.179 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c5013faa0 msgr2=0x7f1c5013bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c5013faa0 0x7f1c5013bcb0 secure :-1 s=READY pgs=3264 cs=0 l=1 rev1=1 crypto rx=0x7f1c4402beb0 tx=0x7f1c440046c0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 shutdown_connections 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7f1c3c06c8b0 0x7f1c3c06ed70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c50145600 0x7f1c50138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c5013faa0 0x7f1c5013bcb0 unknown :-1 s=CLOSED pgs=3264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 --2- 172.21.15.116:0/3868638554 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7f1c500a96e0 0x7f1c500b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 >> 172.21.15.116:0/3868638554 conn(0x7f1c500b7bb0 msgr2=0x7f1c50073f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 shutdown_connections 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 -- 172.21.15.116:0/3868638554 wait complete. 2024-01-23T08:10:56.180 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.177+0000 7f1c57b8e640 1 librados: shutdown 2024-01-23T08:10:56.188 INFO:teuthology.orchestra.run.smithi116.stdout:{"pg_ready":true,"pg_map":{"version":2456,"stamp":"2024-01-23T08:10:55.076172+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459285,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":88,"num_write":120,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":582104,"kb_used_data":39768,"kb_used_omap":12,"kb_used_meta":542259,"kb_avail":754392616,"statfs":{"total":773094113280,"available":772498038784,"internally_reserved":0,"allocated":40722432,"data_stored":19041170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":555273776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002583"},"pg_stats":[{"pgid":"21.5","version":"0'0","reported_seq":2561,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:35.152590+0000","last_change":"2024-01-23T08:10:35.152590+0000","last_active":"2024-01-23T08:10:35.152590+0000","last_peered":"2024-01-23T08:10:35.152590+0000","last_clean":"2024-01-23T08:10:35.152590+0000","last_became_active":"2024-01-23T07:35:49.767110+0000","last_became_peered":"2024-01-23T07:35:49.767110+0000","last_unstale":"2024-01-23T08:10:35.152590+0000","last_undegraded":"2024-01-23T08:10:35.152590+0000","last_fullsized":"2024-01-23T08:10:35.152590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:35.150381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:35.150381+0000","last_clean_scrub_stamp":"2024-01-23T08:10:35.150381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:09:31.658645+0000","scrub_duration":64,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":2556,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:36.099886+0000","last_change":"2024-01-23T08:10:36.100827+0000","last_active":"2024-01-23T08:10:36.099886+0000","last_peered":"2024-01-23T08:10:36.099886+0000","last_clean":"2024-01-23T08:10:36.099886+0000","last_became_active":"2024-01-23T07:46:17.386551+0000","last_became_peered":"2024-01-23T07:46:17.386551+0000","last_unstale":"2024-01-23T08:10:36.099886+0000","last_undegraded":"2024-01-23T08:10:36.099886+0000","last_fullsized":"2024-01-23T08:10:36.099886+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:36.098565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:36.098565+0000","last_clean_scrub_stamp":"2024-01-23T08:10:36.098565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:58:31.599375+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":2079,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:38.030040+0000","last_change":"2024-01-23T08:10:38.030796+0000","last_active":"2024-01-23T08:10:38.030040+0000","last_peered":"2024-01-23T08:10:38.030040+0000","last_clean":"2024-01-23T08:10:38.030040+0000","last_became_active":"2024-01-23T07:40:37.943110+0000","last_became_peered":"2024-01-23T07:40:37.943110+0000","last_unstale":"2024-01-23T08:10:38.030040+0000","last_undegraded":"2024-01-23T08:10:38.030040+0000","last_fullsized":"2024-01-23T08:10:38.030040+0000","mapping_epoch":276,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":277,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:38.028614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:38.028614+0000","last_clean_scrub_stamp":"2024-01-23T08:10:38.028614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T20:03:29.153853+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":2547,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:36.946826+0000","last_change":"2024-01-23T08:10:36.947590+0000","last_active":"2024-01-23T08:10:36.946826+0000","last_peered":"2024-01-23T08:10:36.946826+0000","last_clean":"2024-01-23T08:10:36.946826+0000","last_became_active":"2024-01-23T07:35:17.664344+0000","last_became_peered":"2024-01-23T07:35:17.664344+0000","last_unstale":"2024-01-23T08:10:36.946826+0000","last_undegraded":"2024-01-23T08:10:36.946826+0000","last_fullsized":"2024-01-23T08:10:36.946826+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:36.945434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:36.945434+0000","last_clean_scrub_stamp":"2024-01-23T08:10:36.945434+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:16:49.264254+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":2545,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:38.009162+0000","last_change":"2024-01-23T08:10:38.009949+0000","last_active":"2024-01-23T08:10:38.009162+0000","last_peered":"2024-01-23T08:10:38.009162+0000","last_clean":"2024-01-23T08:10:38.009162+0000","last_became_active":"2024-01-23T07:35:53.492743+0000","last_became_peered":"2024-01-23T07:35:53.492743+0000","last_unstale":"2024-01-23T08:10:38.009162+0000","last_undegraded":"2024-01-23T08:10:38.009162+0000","last_fullsized":"2024-01-23T08:10:38.009162+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:38.007764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:38.007764+0000","last_clean_scrub_stamp":"2024-01-23T08:10:38.007764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T13:18:52.266622+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":2549,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:35.688822+0000","last_change":"2024-01-23T08:10:35.689576+0000","last_active":"2024-01-23T08:10:35.688822+0000","last_peered":"2024-01-23T08:10:35.688822+0000","last_clean":"2024-01-23T08:10:35.688822+0000","last_became_active":"2024-01-23T07:46:16.353670+0000","last_became_peered":"2024-01-23T07:46:16.353670+0000","last_unstale":"2024-01-23T08:10:35.688822+0000","last_undegraded":"2024-01-23T08:10:35.688822+0000","last_fullsized":"2024-01-23T08:10:35.688822+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:35.687184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:35.687184+0000","last_clean_scrub_stamp":"2024-01-23T08:10:35.687184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:45:35.082456+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":2545,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:35.975804+0000","last_change":"2024-01-23T08:10:35.977171+0000","last_active":"2024-01-23T08:10:35.975804+0000","last_peered":"2024-01-23T08:10:35.975804+0000","last_clean":"2024-01-23T08:10:35.975804+0000","last_became_active":"2024-01-23T07:35:17.521909+0000","last_became_peered":"2024-01-23T07:35:17.521909+0000","last_unstale":"2024-01-23T08:10:35.975804+0000","last_undegraded":"2024-01-23T08:10:35.975804+0000","last_fullsized":"2024-01-23T08:10:35.975804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:35.971416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:35.971416+0000","last_clean_scrub_stamp":"2024-01-23T08:10:35.971416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:08:16.415260+0000","scrub_duration":99,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":2541,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:39.747227+0000","last_change":"2024-01-23T08:10:39.747968+0000","last_active":"2024-01-23T08:10:39.747227+0000","last_peered":"2024-01-23T08:10:39.747227+0000","last_clean":"2024-01-23T08:10:39.747227+0000","last_became_active":"2024-01-23T07:46:17.609277+0000","last_became_peered":"2024-01-23T07:46:17.609277+0000","last_unstale":"2024-01-23T08:10:39.747227+0000","last_undegraded":"2024-01-23T08:10:39.747227+0000","last_fullsized":"2024-01-23T08:10:39.747227+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:39.745787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:39.745787+0000","last_clean_scrub_stamp":"2024-01-23T08:10:39.745787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:09:25.454195+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":2545,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:34.901985+0000","last_change":"2024-01-23T08:10:34.902754+0000","last_active":"2024-01-23T08:10:34.901985+0000","last_peered":"2024-01-23T08:10:34.901985+0000","last_clean":"2024-01-23T08:10:34.901985+0000","last_became_active":"2024-01-23T07:35:17.510073+0000","last_became_peered":"2024-01-23T07:35:17.510073+0000","last_unstale":"2024-01-23T08:10:34.901985+0000","last_undegraded":"2024-01-23T08:10:34.901985+0000","last_fullsized":"2024-01-23T08:10:34.901985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:34.900545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:34.900545+0000","last_clean_scrub_stamp":"2024-01-23T08:10:34.900545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:45:32.255565+0000","scrub_duration":76,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":2542,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:36.073089+0000","last_change":"2024-01-23T08:10:36.073882+0000","last_active":"2024-01-23T08:10:36.073089+0000","last_peered":"2024-01-23T08:10:36.073089+0000","last_clean":"2024-01-23T08:10:36.073089+0000","last_became_active":"2024-01-23T07:35:53.376441+0000","last_became_peered":"2024-01-23T07:35:53.376441+0000","last_unstale":"2024-01-23T08:10:36.073089+0000","last_undegraded":"2024-01-23T08:10:36.073089+0000","last_fullsized":"2024-01-23T08:10:36.073089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:36.069580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:36.069580+0000","last_clean_scrub_stamp":"2024-01-23T08:10:36.069580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:44:43.232954+0000","scrub_duration":57,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":2570,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:37.011278+0000","last_change":"2024-01-23T08:10:37.012019+0000","last_active":"2024-01-23T08:10:37.011278+0000","last_peered":"2024-01-23T08:10:37.011278+0000","last_clean":"2024-01-23T08:10:37.011278+0000","last_became_active":"2024-01-23T07:35:26.273730+0000","last_became_peered":"2024-01-23T07:35:26.273730+0000","last_unstale":"2024-01-23T08:10:37.011278+0000","last_undegraded":"2024-01-23T08:10:37.011278+0000","last_fullsized":"2024-01-23T08:10:37.011278+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:37.009910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:37.009910+0000","last_clean_scrub_stamp":"2024-01-23T08:10:37.009910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:54:15.693846+0000","scrub_duration":80,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":2535,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:33.108141+0000","last_change":"2024-01-23T08:10:33.109418+0000","last_active":"2024-01-23T08:10:33.108141+0000","last_peered":"2024-01-23T08:10:33.108141+0000","last_clean":"2024-01-23T08:10:33.108141+0000","last_became_active":"2024-01-23T07:36:02.460264+0000","last_became_peered":"2024-01-23T07:36:02.460264+0000","last_unstale":"2024-01-23T08:10:33.108141+0000","last_undegraded":"2024-01-23T08:10:33.108141+0000","last_fullsized":"2024-01-23T08:10:33.108141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:33.103684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:33.103684+0000","last_clean_scrub_stamp":"2024-01-23T08:10:33.103684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:33:33.170446+0000","scrub_duration":44,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"1323'78","reported_seq":2566,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:30.208237+0000","last_change":"2024-01-23T08:10:30.209607+0000","last_active":"2024-01-23T08:10:30.208237+0000","last_peered":"2024-01-23T08:10:30.208237+0000","last_clean":"2024-01-23T08:10:30.208237+0000","last_became_active":"2024-01-23T07:33:25.600297+0000","last_became_peered":"2024-01-23T07:33:25.600297+0000","last_unstale":"2024-01-23T08:10:30.208237+0000","last_undegraded":"2024-01-23T08:10:30.208237+0000","last_fullsized":"2024-01-23T08:10:30.208237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"1323'78","last_scrub_stamp":"2024-01-23T08:10:30.205620+0000","last_deep_scrub":"1323'78","last_deep_scrub_stamp":"2024-01-23T08:10:30.205620+0000","last_clean_scrub_stamp":"2024-01-23T08:10:30.205620+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:29:13.887875+0000","scrub_duration":125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":2568,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:35.044293+0000","last_change":"2024-01-23T08:10:35.045022+0000","last_active":"2024-01-23T08:10:35.044293+0000","last_peered":"2024-01-23T08:10:35.044293+0000","last_clean":"2024-01-23T08:10:35.044293+0000","last_became_active":"2024-01-23T07:33:32.655848+0000","last_became_peered":"2024-01-23T07:33:32.655848+0000","last_unstale":"2024-01-23T08:10:35.044293+0000","last_undegraded":"2024-01-23T08:10:35.044293+0000","last_fullsized":"2024-01-23T08:10:35.044293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:35.042872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:35.042872+0000","last_clean_scrub_stamp":"2024-01-23T08:10:35.042872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:14:30.775943+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":2568,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:34.945393+0000","last_change":"2024-01-23T08:10:34.946111+0000","last_active":"2024-01-23T08:10:34.945393+0000","last_peered":"2024-01-23T08:10:34.945393+0000","last_clean":"2024-01-23T08:10:34.945393+0000","last_became_active":"2024-01-23T07:35:08.862294+0000","last_became_peered":"2024-01-23T07:35:08.862294+0000","last_unstale":"2024-01-23T08:10:34.945393+0000","last_undegraded":"2024-01-23T08:10:34.945393+0000","last_fullsized":"2024-01-23T08:10:34.945393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:34.944026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:34.944026+0000","last_clean_scrub_stamp":"2024-01-23T08:10:34.944026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:36:26.739277+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":2568,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:32.093264+0000","last_change":"2024-01-23T08:10:32.094297+0000","last_active":"2024-01-23T08:10:32.093264+0000","last_peered":"2024-01-23T08:10:32.093264+0000","last_clean":"2024-01-23T08:10:32.093264+0000","last_became_active":"2024-01-23T07:33:32.242199+0000","last_became_peered":"2024-01-23T07:33:32.242199+0000","last_unstale":"2024-01-23T08:10:32.093264+0000","last_undegraded":"2024-01-23T08:10:32.093264+0000","last_fullsized":"2024-01-23T08:10:32.093264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:32.089678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:32.089678+0000","last_clean_scrub_stamp":"2024-01-23T08:10:32.089678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:50:56.410097+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":2537,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:31.779777+0000","last_change":"2024-01-23T08:10:31.780566+0000","last_active":"2024-01-23T08:10:31.779777+0000","last_peered":"2024-01-23T08:10:31.779777+0000","last_clean":"2024-01-23T08:10:31.779777+0000","last_became_active":"2024-01-23T07:35:57.067585+0000","last_became_peered":"2024-01-23T07:35:57.067585+0000","last_unstale":"2024-01-23T08:10:31.779777+0000","last_undegraded":"2024-01-23T08:10:31.779777+0000","last_fullsized":"2024-01-23T08:10:31.779777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:31.776480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:31.776480+0000","last_clean_scrub_stamp":"2024-01-23T08:10:31.776480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:45:29.650973+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":2562,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:40.717636+0000","last_change":"2024-01-23T08:10:40.718358+0000","last_active":"2024-01-23T08:10:40.717636+0000","last_peered":"2024-01-23T08:10:40.717636+0000","last_clean":"2024-01-23T08:10:40.717636+0000","last_became_active":"2024-01-23T07:46:17.822757+0000","last_became_peered":"2024-01-23T07:46:17.822757+0000","last_unstale":"2024-01-23T08:10:40.717636+0000","last_undegraded":"2024-01-23T08:10:40.717636+0000","last_fullsized":"2024-01-23T08:10:40.717636+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":475,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:40.716304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:40.716304+0000","last_clean_scrub_stamp":"2024-01-23T08:10:40.716304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:11:16.011300+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":2545,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:32.909776+0000","last_change":"2024-01-23T08:10:32.910540+0000","last_active":"2024-01-23T08:10:32.909776+0000","last_peered":"2024-01-23T08:10:32.909776+0000","last_clean":"2024-01-23T08:10:32.909776+0000","last_became_active":"2024-01-23T07:35:17.149780+0000","last_became_peered":"2024-01-23T07:35:17.149780+0000","last_unstale":"2024-01-23T08:10:32.909776+0000","last_undegraded":"2024-01-23T08:10:32.909776+0000","last_fullsized":"2024-01-23T08:10:32.909776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:32.908372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:32.908372+0000","last_clean_scrub_stamp":"2024-01-23T08:10:32.908372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:12:53.608199+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":2568,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:34.020134+0000","last_change":"2024-01-23T08:10:34.020896+0000","last_active":"2024-01-23T08:10:34.020134+0000","last_peered":"2024-01-23T08:10:34.020134+0000","last_clean":"2024-01-23T08:10:34.020134+0000","last_became_active":"2024-01-23T07:33:32.468117+0000","last_became_peered":"2024-01-23T07:33:32.468117+0000","last_unstale":"2024-01-23T08:10:34.020134+0000","last_undegraded":"2024-01-23T08:10:34.020134+0000","last_fullsized":"2024-01-23T08:10:34.020134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:34.018730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:34.018730+0000","last_clean_scrub_stamp":"2024-01-23T08:10:34.018730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T08:27:00.230722+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":2574,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:39.006374+0000","last_change":"2024-01-23T08:10:39.007108+0000","last_active":"2024-01-23T08:10:39.006374+0000","last_peered":"2024-01-23T08:10:39.006374+0000","last_clean":"2024-01-23T08:10:39.006374+0000","last_became_active":"2024-01-23T07:46:17.164304+0000","last_became_peered":"2024-01-23T07:46:17.164304+0000","last_unstale":"2024-01-23T08:10:39.006374+0000","last_undegraded":"2024-01-23T08:10:39.006374+0000","last_fullsized":"2024-01-23T08:10:39.006374+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:39.004925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:39.004925+0000","last_clean_scrub_stamp":"2024-01-23T08:10:39.004925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:33:14.004488+0000","scrub_duration":42,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":2579,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:33.910232+0000","last_change":"2024-01-23T08:10:33.910961+0000","last_active":"2024-01-23T08:10:33.910232+0000","last_peered":"2024-01-23T08:10:33.910232+0000","last_clean":"2024-01-23T08:10:33.910232+0000","last_became_active":"2024-01-23T07:33:32.474543+0000","last_became_peered":"2024-01-23T07:33:32.474543+0000","last_unstale":"2024-01-23T08:10:33.910232+0000","last_undegraded":"2024-01-23T08:10:33.910232+0000","last_fullsized":"2024-01-23T08:10:33.910232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:33.908841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:33.908841+0000","last_clean_scrub_stamp":"2024-01-23T08:10:33.908841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:51:52.706324+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":2559,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:34.187214+0000","last_change":"2024-01-23T08:10:34.187918+0000","last_active":"2024-01-23T08:10:34.187214+0000","last_peered":"2024-01-23T08:10:34.187214+0000","last_clean":"2024-01-23T08:10:34.187214+0000","last_became_active":"2024-01-23T07:35:28.738559+0000","last_became_peered":"2024-01-23T07:35:28.738559+0000","last_unstale":"2024-01-23T08:10:34.187214+0000","last_undegraded":"2024-01-23T08:10:34.187214+0000","last_fullsized":"2024-01-23T08:10:34.187214+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:34.185887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:34.185887+0000","last_clean_scrub_stamp":"2024-01-23T08:10:34.185887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:54:07.843263+0000","scrub_duration":77,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":2568,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:33.071815+0000","last_change":"2024-01-23T08:10:33.073146+0000","last_active":"2024-01-23T08:10:33.071815+0000","last_peered":"2024-01-23T08:10:33.071815+0000","last_clean":"2024-01-23T08:10:33.071815+0000","last_became_active":"2024-01-23T07:33:32.353826+0000","last_became_peered":"2024-01-23T07:33:32.353826+0000","last_unstale":"2024-01-23T08:10:33.071815+0000","last_undegraded":"2024-01-23T08:10:33.071815+0000","last_fullsized":"2024-01-23T08:10:33.071815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:33.065280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:33.065280+0000","last_clean_scrub_stamp":"2024-01-23T08:10:33.065280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T10:25:27.833830+0000","scrub_duration":46,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":2546,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:30.902772+0000","last_change":"2024-01-23T08:10:30.903643+0000","last_active":"2024-01-23T08:10:30.902772+0000","last_peered":"2024-01-23T08:10:30.902772+0000","last_clean":"2024-01-23T08:10:30.902772+0000","last_became_active":"2024-01-23T07:35:16.868129+0000","last_became_peered":"2024-01-23T07:35:16.868129+0000","last_unstale":"2024-01-23T08:10:30.902772+0000","last_undegraded":"2024-01-23T08:10:30.902772+0000","last_fullsized":"2024-01-23T08:10:30.902772+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:30.899350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:30.899350+0000","last_clean_scrub_stamp":"2024-01-23T08:10:30.899350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:54:18.977561+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":2568,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:33.100324+0000","last_change":"2024-01-23T08:10:33.101075+0000","last_active":"2024-01-23T08:10:33.100324+0000","last_peered":"2024-01-23T08:10:33.100324+0000","last_clean":"2024-01-23T08:10:33.100324+0000","last_became_active":"2024-01-23T07:33:32.693171+0000","last_became_peered":"2024-01-23T07:33:32.693171+0000","last_unstale":"2024-01-23T08:10:33.100324+0000","last_undegraded":"2024-01-23T08:10:33.100324+0000","last_fullsized":"2024-01-23T08:10:33.100324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:33.097688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:33.097688+0000","last_clean_scrub_stamp":"2024-01-23T08:10:33.097688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T12:47:04.508729+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":2546,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:31.896596+0000","last_change":"2024-01-23T08:10:31.897369+0000","last_active":"2024-01-23T08:10:31.896596+0000","last_peered":"2024-01-23T08:10:31.896596+0000","last_clean":"2024-01-23T08:10:31.896596+0000","last_became_active":"2024-01-23T07:35:17.011327+0000","last_became_peered":"2024-01-23T07:35:17.011327+0000","last_unstale":"2024-01-23T08:10:31.896596+0000","last_undegraded":"2024-01-23T08:10:31.896596+0000","last_fullsized":"2024-01-23T08:10:31.896596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:31.895184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:31.895184+0000","last_clean_scrub_stamp":"2024-01-23T08:10:31.895184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:55:38.187887+0000","scrub_duration":49,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":2567,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:36.077481+0000","last_change":"2024-01-23T08:10:36.078268+0000","last_active":"2024-01-23T08:10:36.077481+0000","last_peered":"2024-01-23T08:10:36.077481+0000","last_clean":"2024-01-23T08:10:36.077481+0000","last_became_active":"2024-01-23T07:33:32.676672+0000","last_became_peered":"2024-01-23T07:33:32.676672+0000","last_unstale":"2024-01-23T08:10:36.077481+0000","last_undegraded":"2024-01-23T08:10:36.077481+0000","last_fullsized":"2024-01-23T08:10:36.077481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:36.076103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:36.076103+0000","last_clean_scrub_stamp":"2024-01-23T08:10:36.076103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:41:03.118643+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":2546,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:33.875040+0000","last_change":"2024-01-23T08:10:33.875813+0000","last_active":"2024-01-23T08:10:33.875040+0000","last_peered":"2024-01-23T08:10:33.875040+0000","last_clean":"2024-01-23T08:10:33.875040+0000","last_became_active":"2024-01-23T07:35:17.445116+0000","last_became_peered":"2024-01-23T07:35:17.445116+0000","last_unstale":"2024-01-23T08:10:33.875040+0000","last_undegraded":"2024-01-23T08:10:33.875040+0000","last_fullsized":"2024-01-23T08:10:33.875040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:33.873658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:33.873658+0000","last_clean_scrub_stamp":"2024-01-23T08:10:33.873658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T15:26:55.962938+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":2566,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:35.984038+0000","last_change":"2024-01-23T08:10:35.984752+0000","last_active":"2024-01-23T08:10:35.984038+0000","last_peered":"2024-01-23T08:10:35.984038+0000","last_clean":"2024-01-23T08:10:35.984038+0000","last_became_active":"2024-01-23T07:35:23.240102+0000","last_became_peered":"2024-01-23T07:35:23.240102+0000","last_unstale":"2024-01-23T08:10:35.984038+0000","last_undegraded":"2024-01-23T08:10:35.984038+0000","last_fullsized":"2024-01-23T08:10:35.984038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:35.982637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:35.982637+0000","last_clean_scrub_stamp":"2024-01-23T08:10:35.982637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:14:24.974822+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":2515,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:39.986575+0000","last_change":"2024-01-23T08:10:39.987296+0000","last_active":"2024-01-23T08:10:39.986575+0000","last_peered":"2024-01-23T08:10:39.986575+0000","last_clean":"2024-01-23T08:10:39.986575+0000","last_became_active":"2024-01-23T07:36:16.154523+0000","last_became_peered":"2024-01-23T07:36:16.154523+0000","last_unstale":"2024-01-23T08:10:39.986575+0000","last_undegraded":"2024-01-23T08:10:39.986575+0000","last_fullsized":"2024-01-23T08:10:39.986575+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:39.985239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:39.985239+0000","last_clean_scrub_stamp":"2024-01-23T08:10:39.985239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:33:34.139292+0000","scrub_duration":74,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":2548,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:38.978871+0000","last_change":"2024-01-23T08:10:38.979591+0000","last_active":"2024-01-23T08:10:38.978871+0000","last_peered":"2024-01-23T08:10:38.978871+0000","last_clean":"2024-01-23T08:10:38.978871+0000","last_became_active":"2024-01-23T07:35:53.509895+0000","last_became_peered":"2024-01-23T07:35:53.509895+0000","last_unstale":"2024-01-23T08:10:38.978871+0000","last_undegraded":"2024-01-23T08:10:38.978871+0000","last_fullsized":"2024-01-23T08:10:38.978871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:38.977532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:38.977532+0000","last_clean_scrub_stamp":"2024-01-23T08:10:38.977532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T09:26:40.396567+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1","version":"1323'8","reported_seq":2567,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:37.133858+0000","last_change":"2024-01-23T08:10:37.135051+0000","last_active":"2024-01-23T08:10:37.133858+0000","last_peered":"2024-01-23T08:10:37.133858+0000","last_clean":"2024-01-23T08:10:37.133858+0000","last_became_active":"2024-01-23T07:35:25.275034+0000","last_became_peered":"2024-01-23T07:35:25.275034+0000","last_unstale":"2024-01-23T08:10:37.133858+0000","last_undegraded":"2024-01-23T08:10:37.133858+0000","last_fullsized":"2024-01-23T08:10:37.133858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"1323'8","last_scrub_stamp":"2024-01-23T08:10:37.132476+0000","last_deep_scrub":"1323'8","last_deep_scrub_stamp":"2024-01-23T08:10:37.132476+0000","last_clean_scrub_stamp":"2024-01-23T08:10:37.132476+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:00:40.638511+0000","scrub_duration":87,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":2539,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:32.129115+0000","last_change":"2024-01-23T08:10:32.130435+0000","last_active":"2024-01-23T08:10:32.129115+0000","last_peered":"2024-01-23T08:10:32.129115+0000","last_clean":"2024-01-23T08:10:32.129115+0000","last_became_active":"2024-01-23T07:35:15.231845+0000","last_became_peered":"2024-01-23T07:35:15.231845+0000","last_unstale":"2024-01-23T08:10:32.129115+0000","last_undegraded":"2024-01-23T08:10:32.129115+0000","last_fullsized":"2024-01-23T08:10:32.129115+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:32.126920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:32.126920+0000","last_clean_scrub_stamp":"2024-01-23T08:10:32.126920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T16:42:39.254676+0000","scrub_duration":58,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":2550,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:37.720901+0000","last_change":"2024-01-23T08:10:37.721681+0000","last_active":"2024-01-23T08:10:37.720901+0000","last_peered":"2024-01-23T08:10:37.720901+0000","last_clean":"2024-01-23T08:10:37.720901+0000","last_became_active":"2024-01-23T07:46:17.141733+0000","last_became_peered":"2024-01-23T07:46:17.141733+0000","last_unstale":"2024-01-23T08:10:37.720901+0000","last_undegraded":"2024-01-23T08:10:37.720901+0000","last_fullsized":"2024-01-23T08:10:37.720901+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:37.719483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:37.719483+0000","last_clean_scrub_stamp":"2024-01-23T08:10:37.719483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:07:53.772237+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":2540,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:31.091608+0000","last_change":"2024-01-23T08:10:31.092394+0000","last_active":"2024-01-23T08:10:31.091608+0000","last_peered":"2024-01-23T08:10:31.091608+0000","last_clean":"2024-01-23T08:10:31.091608+0000","last_became_active":"2024-01-23T07:35:11.686621+0000","last_became_peered":"2024-01-23T07:35:11.686621+0000","last_unstale":"2024-01-23T08:10:31.091608+0000","last_undegraded":"2024-01-23T08:10:31.091608+0000","last_fullsized":"2024-01-23T08:10:31.091608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:31.085187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:31.085187+0000","last_clean_scrub_stamp":"2024-01-23T08:10:31.085187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T11:14:13.901083+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":2543,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:35.103837+0000","last_change":"2024-01-23T08:10:35.104642+0000","last_active":"2024-01-23T08:10:35.103837+0000","last_peered":"2024-01-23T08:10:35.103837+0000","last_clean":"2024-01-23T08:10:35.103837+0000","last_became_active":"2024-01-23T07:35:52.882762+0000","last_became_peered":"2024-01-23T07:35:52.882762+0000","last_unstale":"2024-01-23T08:10:35.103837+0000","last_undegraded":"2024-01-23T08:10:35.103837+0000","last_fullsized":"2024-01-23T08:10:35.103837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:35.102435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:35.102435+0000","last_clean_scrub_stamp":"2024-01-23T08:10:35.102435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:17:01.460946+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":2534,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:29.823146+0000","last_change":"2024-01-23T08:10:29.823942+0000","last_active":"2024-01-23T08:10:29.823146+0000","last_peered":"2024-01-23T08:10:29.823146+0000","last_clean":"2024-01-23T08:10:29.823146+0000","last_became_active":"2024-01-23T07:35:31.935370+0000","last_became_peered":"2024-01-23T07:35:31.935370+0000","last_unstale":"2024-01-23T08:10:29.823146+0000","last_undegraded":"2024-01-23T08:10:29.823146+0000","last_fullsized":"2024-01-23T08:10:29.823146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:29.821811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:29.821811+0000","last_clean_scrub_stamp":"2024-01-23T08:10:29.821811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T19:59:40.413323+0000","scrub_duration":72,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":2551,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:38.765017+0000","last_change":"2024-01-23T08:10:38.765762+0000","last_active":"2024-01-23T08:10:38.765017+0000","last_peered":"2024-01-23T08:10:38.765017+0000","last_clean":"2024-01-23T08:10:38.765017+0000","last_became_active":"2024-01-23T07:46:17.153624+0000","last_became_peered":"2024-01-23T07:46:17.153624+0000","last_unstale":"2024-01-23T08:10:38.765017+0000","last_undegraded":"2024-01-23T08:10:38.765017+0000","last_fullsized":"2024-01-23T08:10:38.765017+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:38.763634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:38.763634+0000","last_clean_scrub_stamp":"2024-01-23T08:10:38.763634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T14:34:56.742299+0000","scrub_duration":81,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":2535,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:30.768921+0000","last_change":"2024-01-23T08:10:30.769732+0000","last_active":"2024-01-23T08:10:30.768921+0000","last_peered":"2024-01-23T08:10:30.768921+0000","last_clean":"2024-01-23T08:10:30.768921+0000","last_became_active":"2024-01-23T07:35:55.634625+0000","last_became_peered":"2024-01-23T07:35:55.634625+0000","last_unstale":"2024-01-23T08:10:30.768921+0000","last_undegraded":"2024-01-23T08:10:30.768921+0000","last_fullsized":"2024-01-23T08:10:30.768921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:30.767181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:30.767181+0000","last_clean_scrub_stamp":"2024-01-23T08:10:30.767181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T18:24:15.315539+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":2552,"reported_epoch":1323,"state":"active+clean","last_fresh":"2024-01-23T08:10:36.683865+0000","last_change":"2024-01-23T08:10:36.684596+0000","last_active":"2024-01-23T08:10:36.683865+0000","last_peered":"2024-01-23T08:10:36.683865+0000","last_clean":"2024-01-23T08:10:36.683865+0000","last_became_active":"2024-01-23T07:46:17.105960+0000","last_became_peered":"2024-01-23T07:46:17.105960+0000","last_unstale":"2024-01-23T08:10:36.683865+0000","last_undegraded":"2024-01-23T08:10:36.683865+0000","last_fullsized":"2024-01-23T08:10:36.683865+0000","mapping_epoch":473,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":474,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-23T08:10:36.682483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-23T08:10:36.682483+0000","last_clean_scrub_stamp":"2024-01-23T08:10:36.682483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-24T17:45:26.104438+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":397840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":2,"acting":2,"num_store_stats":2},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":3,"up_from":19,"seq":81604379078,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72148,"kb_used_data":4876,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299692,"statfs":{"total":96636764160,"available":96562884608,"internally_reserved":0,"allocated":4993024,"data_stored":2280690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":68876743},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:35 2024","interfaces":[{"interface":"back","average":{"1min":12.852,"5min":25.256,"15min":18.190999999999999},"min":{"1min":4.4870000000000001,"5min":4.4870000000000001,"15min":4.4500000000000002},"max":{"1min":23.759,"5min":226.16999999999999,"15min":259.17200000000003},"last":5.8049999999999997},{"interface":"front","average":{"1min":13.023999999999999,"5min":28.277000000000001,"15min":20.113},"min":{"1min":5.79,"5min":4.5830000000000002,"15min":4.5800000000000001},"max":{"1min":26.756,"5min":335.11099999999999,"15min":335.11099999999999},"last":11.891999999999999}]},{"osd":1,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":11.526999999999999,"5min":25.579000000000001,"15min":20.094999999999999},"min":{"1min":4.7089999999999996,"5min":4.7089999999999996,"15min":4.7089999999999996},"max":{"1min":35.301000000000002,"5min":202.30000000000001,"15min":202.30000000000001},"last":9.4510000000000005},{"interface":"front","average":{"1min":17.094999999999999,"5min":27.420999999999999,"15min":23.341999999999999},"min":{"1min":7.7770000000000001,"5min":7.0030000000000001,"15min":6.8550000000000004},"max":{"1min":46.988999999999997,"5min":129.023,"15min":213.935},"last":10.361000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:10:18 2024","interfaces":[{"interface":"back","average":{"1min":17.052,"5min":41.604999999999997,"15min":31.245999999999999},"min":{"1min":7.8029999999999999,"5min":6.6710000000000003,"15min":6.5270000000000001},"max":{"1min":30.015999999999998,"5min":689.02099999999996,"15min":689.02099999999996},"last":12.273},{"interface":"front","average":{"1min":15.247999999999999,"5min":30.026,"15min":27.16},"min":{"1min":8.3960000000000008,"5min":6.556,"15min":6.556},"max":{"1min":26.483000000000001,"5min":363.96699999999998,"15min":386.762},"last":13.09}]},{"osd":4,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":20.992999999999999,"5min":25.806999999999999,"15min":24.355},"min":{"1min":10.17,"5min":7.8150000000000004,"15min":7.8150000000000004},"max":{"1min":59.957000000000001,"5min":172.78299999999999,"15min":289.80599999999998},"last":14.506},{"interface":"front","average":{"1min":22.202999999999999,"5min":29.404,"15min":28.827999999999999},"min":{"1min":10.856999999999999,"5min":9.9879999999999995,"15min":9.5510000000000002},"max":{"1min":60.607999999999997,"5min":177.40000000000001,"15min":307.245},"last":16.759}]},{"osd":5,"last update":"Tue Jan 23 08:10:35 2024","interfaces":[{"interface":"back","average":{"1min":21.969999999999999,"5min":29.242999999999999,"15min":28.064},"min":{"1min":8.7550000000000008,"5min":6.8029999999999999,"15min":6.8029999999999999},"max":{"1min":85.647000000000006,"5min":201.06200000000001,"15min":359.69900000000001},"last":13.741},{"interface":"front","average":{"1min":24.244,"5min":29.762,"15min":28.780999999999999},"min":{"1min":11.420999999999999,"5min":10.411,"15min":9.407},"max":{"1min":87.959000000000003,"5min":149.059,"15min":334.642},"last":18.242000000000001}]},{"osd":6,"last update":"Tue Jan 23 08:09:54 2024","interfaces":[{"interface":"back","average":{"1min":23.018999999999998,"5min":32.515999999999998,"15min":32.387999999999998},"min":{"1min":10.845000000000001,"5min":8.4260000000000002,"15min":8.4260000000000002},"max":{"1min":73.620999999999995,"5min":199.66399999999999,"15min":341.05700000000002},"last":16.113},{"interface":"front","average":{"1min":29.157,"5min":34.218000000000004,"15min":29.725000000000001},"min":{"1min":15.654,"5min":11.496,"15min":6.6390000000000002},"max":{"1min":101.759,"5min":162.982,"15min":334.94600000000003},"last":19.574000000000002}]},{"osd":7,"last update":"Tue Jan 23 08:09:55 2024","interfaces":[{"interface":"back","average":{"1min":14.962999999999999,"5min":23.611000000000001,"15min":25.231000000000002},"min":{"1min":7.3460000000000001,"5min":7.298,"15min":7.2309999999999999},"max":{"1min":63.154000000000003,"5min":191.524,"15min":223.053},"last":7.6210000000000004},{"interface":"front","average":{"1min":25.978000000000002,"5min":33.332000000000001,"15min":25.420000000000002},"min":{"1min":9.9719999999999995,"5min":8.4459999999999997,"15min":6.9189999999999996},"max":{"1min":99.994,"5min":211.773,"15min":281.75299999999999},"last":17.413}]}]},{"osd":1,"up_from":19,"seq":81604379077,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72536,"kb_used_data":5264,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299304,"statfs":{"total":96636764160,"available":96562487296,"internally_reserved":0,"allocated":5390336,"data_stored":2678525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:26 2024","interfaces":[{"interface":"back","average":{"1min":16.315999999999999,"5min":22.128,"15min":19.146000000000001},"min":{"1min":6.4429999999999996,"5min":5.4100000000000001,"15min":5.4100000000000001},"max":{"1min":94.590999999999994,"5min":174.22800000000001,"15min":244.16},"last":7.6900000000000004},{"interface":"front","average":{"1min":22.446000000000002,"5min":28.849,"15min":27.295000000000002},"min":{"1min":10.259,"5min":6.7830000000000004,"15min":6.7830000000000004},"max":{"1min":97.444000000000003,"5min":198.155,"15min":247.33699999999999},"last":11.144}]},{"osd":2,"last update":"Tue Jan 23 08:10:33 2024","interfaces":[{"interface":"back","average":{"1min":23.510000000000002,"5min":26.966000000000001,"15min":25.984999999999999},"min":{"1min":9.5890000000000004,"5min":8.266,"15min":6.2699999999999996},"max":{"1min":105.404,"5min":207.15100000000001,"15min":243.33000000000001},"last":8.6980000000000004},{"interface":"front","average":{"1min":19.617999999999999,"5min":20.561,"15min":25.181000000000001},"min":{"1min":6.1040000000000001,"5min":4.915,"15min":4.915},"max":{"1min":98.590000000000003,"5min":167.71199999999999,"15min":366.99700000000001},"last":9.8620000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:10:48 2024","interfaces":[{"interface":"back","average":{"1min":11.826000000000001,"5min":26.847000000000001,"15min":22.335999999999999},"min":{"1min":6.9870000000000001,"5min":6.0270000000000001,"15min":5.3650000000000002},"max":{"1min":25.620999999999999,"5min":291.79300000000001,"15min":291.79300000000001},"last":12.369999999999999},{"interface":"front","average":{"1min":18.324000000000002,"5min":21.681999999999999,"15min":24.823},"min":{"1min":8.7530000000000001,"5min":5.3289999999999997,"15min":5.3289999999999997},"max":{"1min":32.134,"5min":221.50899999999999,"15min":398.98599999999999},"last":10.56}]},{"osd":4,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":23.504999999999999,"5min":30.498000000000001,"15min":32.963000000000001},"min":{"1min":11.525,"5min":8.2940000000000005,"15min":7.641},"max":{"1min":36.862000000000002,"5min":204.095,"15min":572.26999999999998},"last":14.278},{"interface":"front","average":{"1min":12.919,"5min":16.268999999999998,"15min":20.911000000000001},"min":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"max":{"1min":40.198,"5min":78.813000000000002,"15min":411.84399999999999},"last":6.8280000000000003}]},{"osd":5,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":29.154,"5min":28.667000000000002,"15min":31.228000000000002},"min":{"1min":7.6900000000000004,"5min":7.6900000000000004,"15min":7.6900000000000004},"max":{"1min":106.607,"5min":168.93000000000001,"15min":376.55700000000002},"last":13.035},{"interface":"front","average":{"1min":29.056000000000001,"5min":26.309999999999999,"15min":27.195},"min":{"1min":7.7670000000000003,"5min":7.7670000000000003,"15min":6.3959999999999999},"max":{"1min":91.256,"5min":173.46899999999999,"15min":364.32600000000002},"last":11.743}]},{"osd":6,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":25.513999999999999,"5min":31.672000000000001,"15min":34.091000000000001},"min":{"1min":15.657999999999999,"5min":10.664,"15min":10.664},"max":{"1min":53.466000000000001,"5min":174.54400000000001,"15min":377.375},"last":15.779999999999999},{"interface":"front","average":{"1min":22.515000000000001,"5min":26.417999999999999,"15min":26.864000000000001},"min":{"1min":9.1940000000000008,"5min":7.0590000000000002,"15min":7.0590000000000002},"max":{"1min":93.706999999999994,"5min":176.499,"15min":248.40000000000001},"last":13.640000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:10:01 2024","interfaces":[{"interface":"back","average":{"1min":21.986000000000001,"5min":26.722999999999999,"15min":22.699999999999999},"min":{"1min":9.6899999999999995,"5min":6.8049999999999997,"15min":6.8049999999999997},"max":{"1min":95.328000000000003,"5min":309.55900000000003,"15min":309.55900000000003},"last":15.035},{"interface":"front","average":{"1min":24.766999999999999,"5min":30.609999999999999,"15min":27.841000000000001},"min":{"1min":11.859999999999999,"5min":11.134,"15min":8.3670000000000009},"max":{"1min":98.653000000000006,"5min":169.82300000000001,"15min":245.946},"last":18.097999999999999}]}]},{"osd":4,"up_from":18,"seq":77309411782,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76308,"kb_used_data":4876,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94295532,"statfs":{"total":96636764160,"available":96558624768,"internally_reserved":0,"allocated":4993024,"data_stored":2280690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":14.598000000000001,"5min":23.437999999999999,"15min":22.77},"min":{"1min":5.8570000000000002,"5min":5.2850000000000001,"15min":5.2850000000000001},"max":{"1min":98.227999999999994,"5min":371.233,"15min":371.233},"last":17.004999999999999},{"interface":"front","average":{"1min":18.530999999999999,"5min":24.696000000000002,"15min":25.018000000000001},"min":{"1min":7.8490000000000002,"5min":6.1909999999999998,"15min":5.9210000000000003},"max":{"1min":106.56699999999999,"5min":244.11199999999999,"15min":351.55700000000002},"last":19.675000000000001}]},{"osd":1,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":25.187000000000001,"5min":25.859999999999999,"15min":26.457999999999998},"min":{"1min":8.4510000000000005,"5min":6.3609999999999998,"15min":5.6040000000000001},"max":{"1min":147.08799999999999,"5min":260.22500000000002,"15min":353.72699999999998},"last":17.899999999999999},{"interface":"front","average":{"1min":28.363,"5min":33.558,"15min":32.466999999999999},"min":{"1min":12.493,"5min":10.728999999999999,"15min":7.5830000000000002},"max":{"1min":149.196,"5min":271.54700000000003,"15min":352.48700000000002},"last":21.445}]},{"osd":2,"last update":"Tue Jan 23 08:10:30 2024","interfaces":[{"interface":"back","average":{"1min":10.343,"5min":48.07,"15min":29.359999999999999},"min":{"1min":5.234,"5min":4.6280000000000001,"15min":4.5800000000000001},"max":{"1min":20.648,"5min":2731.4580000000001,"15min":2731.4580000000001},"last":15.893000000000001},{"interface":"front","average":{"1min":9.8219999999999992,"5min":42.253999999999998,"15min":26.823},"min":{"1min":6.2859999999999996,"5min":6.0810000000000004,"15min":4.6040000000000001},"max":{"1min":20.413,"5min":1368.422,"15min":1368.422},"last":11.148}]},{"osd":3,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":14.923,"5min":21.501000000000001,"15min":27.437000000000001},"min":{"1min":6.3579999999999997,"5min":6.3579999999999997,"15min":6.3579999999999997},"max":{"1min":92.784999999999997,"5min":185.97900000000001,"15min":367.24000000000001},"last":12.486000000000001},{"interface":"front","average":{"1min":21.876999999999999,"5min":30.088999999999999,"15min":28.812000000000001},"min":{"1min":12.944000000000001,"5min":10.311,"15min":6.4779999999999998},"max":{"1min":109.018,"5min":502.47000000000003,"15min":502.47000000000003},"last":18.777999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:09:56 2024","interfaces":[{"interface":"back","average":{"1min":18.542000000000002,"5min":19.931000000000001,"15min":22.861999999999998},"min":{"1min":5.859,"5min":5.859,"15min":5.859},"max":{"1min":92.823999999999998,"5min":109.624,"15min":482.44299999999998},"last":10.23},{"interface":"front","average":{"1min":20.876000000000001,"5min":25.094000000000001,"15min":23.469000000000001},"min":{"1min":8.7230000000000008,"5min":6.1280000000000001,"15min":5.3170000000000002},"max":{"1min":108.36499999999999,"5min":227.20500000000001,"15min":339.04300000000001},"last":14.805}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.561,"5min":25.599,"15min":28.395},"min":{"1min":9.6229999999999993,"5min":7.8109999999999999,"15min":7.8109999999999999},"max":{"1min":110.756,"5min":300.51999999999998,"15min":353.113},"last":13.276999999999999},{"interface":"front","average":{"1min":23.277000000000001,"5min":28.373000000000001,"15min":27.132000000000001},"min":{"1min":12.647,"5min":10.74,"15min":6.8090000000000002},"max":{"1min":109.562,"5min":208.05699999999999,"15min":349.64499999999998},"last":20.574999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":26.695,"5min":34.959000000000003,"15min":32.031999999999996},"min":{"1min":15.186,"5min":7.7939999999999996,"15min":7.3719999999999999},"max":{"1min":116.116,"5min":275.20999999999998,"15min":395.82299999999998},"last":22.309999999999999},{"interface":"front","average":{"1min":26.236000000000001,"5min":35.244,"15min":32.054000000000002},"min":{"1min":16.350999999999999,"5min":12.57,"15min":6.4859999999999998},"max":{"1min":124.672,"5min":184.47499999999999,"15min":438.92000000000002},"last":23.193000000000001}]}]},{"osd":7,"up_from":473,"seq":2031519531445,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72144,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299696,"statfs":{"total":96636764160,"available":96562888704,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":68876746},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":10.305999999999999,"5min":22.015000000000001,"15min":16.207999999999998},"min":{"1min":5.8280000000000003,"5min":5.6550000000000002,"15min":4.9550000000000001},"max":{"1min":24.335000000000001,"5min":282.28800000000001,"15min":282.28800000000001},"last":12.898},{"interface":"front","average":{"1min":18.126999999999999,"5min":28.951000000000001,"15min":22.047000000000001},"min":{"1min":8.6720000000000006,"5min":7.4989999999999997,"15min":5.476},"max":{"1min":48.290999999999997,"5min":285.887,"15min":285.887},"last":14.336}]},{"osd":1,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":15.558999999999999,"5min":18.123999999999999,"15min":18.305},"min":{"1min":6.7359999999999998,"5min":4.8440000000000003,"15min":4.6509999999999998},"max":{"1min":74.322999999999993,"5min":162.80500000000001,"15min":199.09399999999999},"last":11.1},{"interface":"front","average":{"1min":15.768000000000001,"5min":25.341999999999999,"15min":22.677},"min":{"1min":5.4089999999999998,"5min":5.4089999999999998,"15min":5.1550000000000002},"max":{"1min":86.662000000000006,"5min":238.892,"15min":280.24299999999999},"last":6.6399999999999997}]},{"osd":2,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.838000000000001,"5min":37.078000000000003,"15min":25.183},"min":{"1min":10.106999999999999,"5min":6.8150000000000004,"15min":5.8129999999999997},"max":{"1min":38.683,"5min":1088.116,"15min":1088.116},"last":17.149999999999999},{"interface":"front","average":{"1min":14.474,"5min":35.444000000000003,"15min":25.821000000000002},"min":{"1min":8.9239999999999995,"5min":6.9080000000000004,"15min":5.2699999999999996},"max":{"1min":34.753,"5min":1187.3219999999999,"15min":1187.3219999999999},"last":9.6669999999999998}]},{"osd":3,"last update":"Tue Jan 23 08:10:15 2024","interfaces":[{"interface":"back","average":{"1min":19.507000000000001,"5min":23.98,"15min":22.635999999999999},"min":{"1min":8.1560000000000006,"5min":7.7309999999999999,"15min":6.1749999999999998},"max":{"1min":65.203999999999994,"5min":177.09700000000001,"15min":313.31099999999998},"last":8.6050000000000004},{"interface":"front","average":{"1min":24.954999999999998,"5min":25.353000000000002,"15min":23.792000000000002},"min":{"1min":9.6549999999999994,"5min":6.3029999999999999,"15min":6.3029999999999999},"max":{"1min":84.671999999999997,"5min":179.13999999999999,"15min":228.626},"last":15.005000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":19.268000000000001,"5min":25.036000000000001,"15min":23.661000000000001},"min":{"1min":7.444,"5min":6.5149999999999997,"15min":6.4850000000000003},"max":{"1min":64.384,"5min":206.381,"15min":277.70400000000001},"last":7.5439999999999996},{"interface":"front","average":{"1min":19.050999999999998,"5min":24.832999999999998,"15min":23.053000000000001},"min":{"1min":10.968,"5min":7.7930000000000001,"15min":7.7930000000000001},"max":{"1min":34.298999999999999,"5min":186.768,"15min":320.26799999999997},"last":13.644}]},{"osd":5,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":18.742999999999999,"5min":29.033999999999999,"15min":25.672999999999998},"min":{"1min":8.7370000000000001,"5min":8.6809999999999992,"15min":8.0350000000000001},"max":{"1min":29.145,"5min":323.63400000000001,"15min":323.63400000000001},"last":16.454000000000001},{"interface":"front","average":{"1min":20.257000000000001,"5min":29.279,"15min":26.036000000000001},"min":{"1min":6.5529999999999999,"5min":6.5529999999999999,"15min":6.5529999999999999},"max":{"1min":69.991,"5min":263.19799999999998,"15min":263.19799999999998},"last":10.308}]},{"osd":6,"last update":"Tue Jan 23 08:10:07 2024","interfaces":[{"interface":"back","average":{"1min":16.844000000000001,"5min":26.978999999999999,"15min":25.648},"min":{"1min":8.0589999999999993,"5min":7.8849999999999998,"15min":7.1449999999999996},"max":{"1min":36.491,"5min":232.35599999999999,"15min":232.35599999999999},"last":15.791},{"interface":"front","average":{"1min":19.102,"5min":30.035,"15min":26.268000000000001},"min":{"1min":10.395,"5min":7.8029999999999999,"15min":7.4320000000000004},"max":{"1min":29.07,"5min":283.27800000000002,"15min":435.91899999999998},"last":19.076000000000001}]}]},{"osd":2,"up_from":16,"seq":68719477177,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72144,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299696,"statfs":{"total":96636764160,"available":96562888704,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":15.401999999999999,"5min":29.079000000000001,"15min":18.780000000000001},"min":{"1min":5.2670000000000003,"5min":3.9039999999999999,"15min":3.9039999999999999},"max":{"1min":103.72799999999999,"5min":1085.3969999999999,"15min":1085.3969999999999},"last":7.0709999999999997},{"interface":"front","average":{"1min":14.44,"5min":33.171999999999997,"15min":23.239999999999998},"min":{"1min":4.7549999999999999,"5min":4.7549999999999999,"15min":4.5380000000000003},"max":{"1min":81.522999999999996,"5min":938.18899999999996,"15min":938.18899999999996},"last":7.6980000000000004}]},{"osd":1,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":13.436999999999999,"5min":23.271000000000001,"15min":21.917999999999999},"min":{"1min":7.5289999999999999,"5min":5.2000000000000002,"15min":5.0389999999999997},"max":{"1min":35.811,"5min":281.33499999999998,"15min":310.05200000000002},"last":8.7840000000000007},{"interface":"front","average":{"1min":17.768000000000001,"5min":39.762,"15min":31.893999999999998},"min":{"1min":7.1230000000000002,"5min":7.1230000000000002,"15min":6.2220000000000004},"max":{"1min":71.415000000000006,"5min":969.31899999999996,"15min":969.31899999999996},"last":12.340999999999999}]},{"osd":3,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":15.061999999999999,"5min":36.173000000000002,"15min":27.225000000000001},"min":{"1min":8.5879999999999992,"5min":6.5270000000000001,"15min":5.9909999999999997},"max":{"1min":57.829999999999998,"5min":1096.0550000000001,"15min":1096.0550000000001},"last":11.013},{"interface":"front","average":{"1min":23.227,"5min":39.137999999999998,"15min":29.553999999999998},"min":{"1min":10.298999999999999,"5min":9.1189999999999998,"15min":8.1910000000000007},"max":{"1min":97.673000000000002,"5min":1097.8199999999999,"15min":1097.8199999999999},"last":10.275}]},{"osd":4,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":15.143000000000001,"5min":29.646999999999998,"15min":27.18},"min":{"1min":7.1609999999999996,"5min":7.1500000000000004,"15min":6.742},"max":{"1min":31.036000000000001,"5min":454.44299999999998,"15min":454.44299999999998},"last":14.16},{"interface":"front","average":{"1min":18.111999999999998,"5min":35.648000000000003,"15min":28.036000000000001},"min":{"1min":11.343,"5min":8.423,"15min":7.5380000000000003},"max":{"1min":30.052,"5min":1087.472,"15min":1087.472},"last":14.779999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":18.588999999999999,"5min":29.565000000000001,"15min":24.881},"min":{"1min":10.234999999999999,"5min":8.1760000000000002,"15min":8.0719999999999992},"max":{"1min":31.911999999999999,"5min":455.05500000000001,"15min":455.05500000000001},"last":17.257000000000001},{"interface":"front","average":{"1min":24.645,"5min":35.680999999999997,"15min":29.52},"min":{"1min":11.773,"5min":9.9220000000000006,"15min":9.1500000000000004},"max":{"1min":40.094999999999999,"5min":455.66699999999997,"15min":455.66699999999997},"last":17.989999999999998}]},{"osd":6,"last update":"Tue Jan 23 08:10:27 2024","interfaces":[{"interface":"back","average":{"1min":20.286000000000001,"5min":41.944000000000003,"15min":29.588999999999999},"min":{"1min":8.9420000000000002,"5min":7.6719999999999997,"15min":7.6719999999999997},"max":{"1min":79.620000000000005,"5min":977.35299999999995,"15min":977.35299999999995},"last":9.5150000000000006},{"interface":"front","average":{"1min":26.472000000000001,"5min":46.683,"15min":32.813000000000002},"min":{"1min":12.85,"5min":9.0060000000000002,"15min":9.0060000000000002},"max":{"1min":89.191999999999993,"5min":982.83100000000002,"15min":982.83100000000002},"last":13.505000000000001}]},{"osd":7,"last update":"Tue Jan 23 08:10:04 2024","interfaces":[{"interface":"back","average":{"1min":27.013000000000002,"5min":50.5,"15min":33.725999999999999},"min":{"1min":11.968,"5min":10.092000000000001,"15min":8.9199999999999999},"max":{"1min":149.69399999999999,"5min":979.63699999999994,"15min":979.63699999999994},"last":12.962},{"interface":"front","average":{"1min":35.767000000000003,"5min":57.726999999999997,"15min":38.661000000000001},"min":{"1min":15.068,"5min":10.776999999999999,"15min":8.4049999999999994},"max":{"1min":156.78100000000001,"5min":984.54899999999998,"15min":984.54899999999998},"last":15.516}]}]},{"osd":0,"up_from":14,"seq":60129542595,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72144,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299696,"statfs":{"total":96636764160,"available":96562888704,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jan 23 08:10:42 2024","interfaces":[{"interface":"back","average":{"1min":12.574999999999999,"5min":24.812999999999999,"15min":18.614999999999998},"min":{"1min":5.202,"5min":5.202,"15min":4.6289999999999996},"max":{"1min":22.289999999999999,"5min":240.86000000000001,"15min":259.21699999999998},"last":9.7140000000000004},{"interface":"front","average":{"1min":15.906000000000001,"5min":32.655999999999999,"15min":21.808},"min":{"1min":8.843,"5min":8.3789999999999996,"15min":4.3719999999999999},"max":{"1min":25.780999999999999,"5min":241.94999999999999,"15min":241.94999999999999},"last":12.599}]},{"osd":2,"last update":"Tue Jan 23 08:10:33 2024","interfaces":[{"interface":"back","average":{"1min":11.958,"5min":30.911000000000001,"15min":22.045000000000002},"min":{"1min":5.9729999999999999,"5min":5.6349999999999998,"15min":4.8499999999999996},"max":{"1min":30.334,"5min":272.22300000000001,"15min":272.22300000000001},"last":8.8680000000000003},{"interface":"front","average":{"1min":19.536000000000001,"5min":42.151000000000003,"15min":28.077000000000002},"min":{"1min":10.435,"5min":10.09,"15min":5.8470000000000004},"max":{"1min":35.152000000000001,"5min":272.08100000000002,"15min":328.67500000000001},"last":15.097}]},{"osd":3,"last update":"Tue Jan 23 08:10:42 2024","interfaces":[{"interface":"back","average":{"1min":19.498999999999999,"5min":31.637,"15min":23.382999999999999},"min":{"1min":11.305,"5min":8.4719999999999995,"15min":6.7539999999999996},"max":{"1min":30.776,"5min":205.28700000000001,"15min":205.28700000000001},"last":16.513999999999999},{"interface":"front","average":{"1min":14.789,"5min":26.765999999999998,"15min":20.584},"min":{"1min":8.5239999999999991,"5min":6.556,"15min":6.2450000000000001},"max":{"1min":27.919,"5min":205.19499999999999,"15min":205.19499999999999},"last":13.787000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:10:42 2024","interfaces":[{"interface":"back","average":{"1min":17.178000000000001,"5min":30.936,"15min":22.876000000000001},"min":{"1min":7.8310000000000004,"5min":7.8310000000000004,"15min":6.6689999999999996},"max":{"1min":28.571000000000002,"5min":270.214,"15min":270.214},"last":14.468999999999999},{"interface":"front","average":{"1min":12.576000000000001,"5min":23.722999999999999,"15min":18.856000000000002},"min":{"1min":6.6529999999999996,"5min":6.4409999999999998,"15min":6.0579999999999998},"max":{"1min":27.231000000000002,"5min":206.066,"15min":206.066},"last":8.4280000000000008}]},{"osd":5,"last update":"Tue Jan 23 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":20.132999999999999,"5min":37.779000000000003,"15min":28.468},"min":{"1min":11.551,"5min":10.859,"15min":7.3689999999999998},"max":{"1min":32.174999999999997,"5min":266.38900000000001,"15min":269.887},"last":18.638999999999999},{"interface":"front","average":{"1min":11.813000000000001,"5min":24.454999999999998,"15min":21.344000000000001},"min":{"1min":6.9660000000000002,"5min":6.5090000000000003,"15min":5.431},"max":{"1min":30.079999999999998,"5min":267.16199999999998,"15min":267.16199999999998},"last":9.4510000000000005}]},{"osd":6,"last update":"Tue Jan 23 08:10:42 2024","interfaces":[{"interface":"back","average":{"1min":18.614999999999998,"5min":32.359999999999999,"15min":27.510000000000002},"min":{"1min":11.914999999999999,"5min":8.4410000000000007,"15min":8.4410000000000007},"max":{"1min":33.552999999999997,"5min":306.05900000000003,"15min":306.05900000000003},"last":15.762},{"interface":"front","average":{"1min":15.644,"5min":27.292000000000002,"15min":24.088000000000001},"min":{"1min":9.2170000000000005,"5min":7.2850000000000001,"15min":7.2149999999999999},"max":{"1min":36.176000000000002,"5min":235.76599999999999,"15min":235.76599999999999},"last":11.260999999999999}]},{"osd":7,"last update":"Tue Jan 23 08:10:00 2024","interfaces":[{"interface":"back","average":{"1min":22.579999999999998,"5min":41,"15min":28.344999999999999},"min":{"1min":15.906000000000001,"5min":12.061,"15min":6.9009999999999998},"max":{"1min":39.82,"5min":234.15700000000001,"15min":234.15700000000001},"last":17.879000000000001},{"interface":"front","average":{"1min":16.991,"5min":31.675999999999998,"15min":25.094999999999999},"min":{"1min":9.718,"5min":8.4979999999999993,"15min":6.6929999999999996},"max":{"1min":30.414999999999999,"5min":239.101,"15min":246.71799999999999},"last":11.869999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575300,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72144,"kb_used_data":4872,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299696,"statfs":{"total":96636764160,"available":96562888704,"internally_reserved":0,"allocated":4988928,"data_stored":2280685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.843,"5min":21.023,"15min":20.405999999999999},"min":{"1min":6.4370000000000003,"5min":5.6959999999999997,"15min":4.5039999999999996},"max":{"1min":27.398,"5min":168.251,"15min":312.25599999999997},"last":9.7550000000000008},{"interface":"front","average":{"1min":16.335999999999999,"5min":31.129999999999999,"15min":26.777000000000001},"min":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":5.2380000000000004},"max":{"1min":30.542000000000002,"5min":253.14500000000001,"15min":312.85199999999998},"last":16.925999999999998}]},{"osd":1,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.454999999999998,"5min":20.600000000000001,"15min":21.294},"min":{"1min":6.4470000000000001,"5min":5.1029999999999998,"15min":5.1029999999999998},"max":{"1min":72.905000000000001,"5min":174.38800000000001,"15min":310.94200000000001},"last":11.398999999999999},{"interface":"front","average":{"1min":11.943,"5min":19.451000000000001,"15min":24.952999999999999},"min":{"1min":6.5999999999999996,"5min":5.8339999999999996,"15min":5.8339999999999996},"max":{"1min":40.143999999999998,"5min":208.99199999999999,"15min":285.43599999999998},"last":7.3140000000000001}]},{"osd":2,"last update":"Tue Jan 23 08:10:22 2024","interfaces":[{"interface":"back","average":{"1min":15.574,"5min":44.034999999999997,"15min":27.588000000000001},"min":{"1min":5.6660000000000004,"5min":5.6660000000000004,"15min":5.6660000000000004},"max":{"1min":73.838999999999999,"5min":1676.316,"15min":1676.316},"last":8.6780000000000008},{"interface":"front","average":{"1min":20.335999999999999,"5min":48.231999999999999,"15min":32.299999999999997},"min":{"1min":10.959,"5min":6.6260000000000003,"15min":6.6260000000000003},"max":{"1min":75.010000000000005,"5min":1582.598,"15min":1582.598},"last":13.788}]},{"osd":3,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":19.201000000000001,"5min":25.422000000000001,"15min":24.648},"min":{"1min":10.119999999999999,"5min":10.119999999999999,"15min":7.8049999999999997},"max":{"1min":33.652000000000001,"5min":138.828,"15min":311.21300000000002},"last":15.173},{"interface":"front","average":{"1min":20.939,"5min":27.923999999999999,"15min":28.23},"min":{"1min":12.728999999999999,"5min":10.895,"15min":10.42},"max":{"1min":34.484999999999999,"5min":180.071,"15min":313.44200000000001},"last":17.748000000000001}]},{"osd":4,"last update":"Tue Jan 23 08:10:12 2024","interfaces":[{"interface":"back","average":{"1min":11.15,"5min":17.157,"15min":17.864000000000001},"min":{"1min":5.282,"5min":5.2320000000000002,"15min":5.2320000000000002},"max":{"1min":31.683,"5min":163.13399999999999,"15min":355.80000000000001},"last":10.406000000000001},{"interface":"front","average":{"1min":16.738,"5min":23.565000000000001,"15min":23.312000000000001},"min":{"1min":9.1180000000000003,"5min":6.9829999999999997,"15min":6.9829999999999997},"max":{"1min":29.797999999999998,"5min":172.30799999999999,"15min":331.42500000000001},"last":12.430999999999999}]},{"osd":5,"last update":"Tue Jan 23 08:10:40 2024","interfaces":[{"interface":"back","average":{"1min":19.956,"5min":26.52,"15min":26.216000000000001},"min":{"1min":10.879,"5min":8.5679999999999996,"15min":7.8380000000000001},"max":{"1min":39.667999999999999,"5min":199.66999999999999,"15min":259.23200000000003},"last":18.515999999999998},{"interface":"front","average":{"1min":24.919,"5min":32.649000000000001,"15min":31.388999999999999},"min":{"1min":13.395,"5min":9.7319999999999993,"15min":9.7319999999999993},"max":{"1min":48.054000000000002,"5min":200.33099999999999,"15min":278.38400000000001},"last":19.292000000000002}]},{"osd":7,"last update":"Tue Jan 23 08:10:17 2024","interfaces":[{"interface":"back","average":{"1min":12.960000000000001,"5min":20.105,"15min":21.783999999999999},"min":{"1min":6.1950000000000003,"5min":6.1950000000000003,"15min":6.1769999999999996},"max":{"1min":38.274000000000001,"5min":167.12100000000001,"15min":343.786},"last":13.113},{"interface":"front","average":{"1min":20.988,"5min":31.399999999999999,"15min":29.193999999999999},"min":{"1min":10.363,"5min":10.363,"15min":10.363},"max":{"1min":68.890000000000001,"5min":186.30199999999999,"15min":302.589},"last":14.448}]}]},{"osd":5,"up_from":13,"seq":55834575301,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72536,"kb_used_data":5264,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94299304,"statfs":{"total":96636764160,"available":96562487296,"internally_reserved":0,"allocated":5390336,"data_stored":2678525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jan 23 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":11.385,"5min":15.583,"15min":16.635999999999999},"min":{"1min":5.0910000000000002,"5min":4.3899999999999997,"15min":4.3849999999999998},"max":{"1min":54.390999999999998,"5min":107.895,"15min":301.08300000000003},"last":4.9180000000000001},{"interface":"front","average":{"1min":13.372,"5min":15.694000000000001,"15min":17.951000000000001},"min":{"1min":5.601,"5min":4.46,"15min":4.46},"max":{"1min":62.031999999999996,"5min":112.321,"15min":299.28699999999998},"last":9.0389999999999997}]},{"osd":1,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":18.789999999999999,"5min":16.811,"15min":21.641999999999999},"min":{"1min":7.4450000000000003,"5min":6.0640000000000001,"15min":6.0640000000000001},"max":{"1min":48.829999999999998,"5min":108.367,"15min":335.601},"last":10.535},{"interface":"front","average":{"1min":15.991,"5min":15.215999999999999,"15min":18.478000000000002},"min":{"1min":6.2990000000000004,"5min":6.2990000000000004,"15min":5.9269999999999996},"max":{"1min":35.363,"5min":95.385000000000005,"15min":338.95499999999998},"last":11.936999999999999}]},{"osd":2,"last update":"Tue Jan 23 08:10:20 2024","interfaces":[{"interface":"back","average":{"1min":15.198,"5min":20.091999999999999,"15min":22.443000000000001},"min":{"1min":6.915,"5min":6.3940000000000001,"15min":6.2859999999999996},"max":{"1min":39.262999999999998,"5min":122.42700000000001,"15min":280.85399999999998},"last":9.8780000000000001},{"interface":"front","average":{"1min":15.127000000000001,"5min":20.622,"15min":23.937999999999999},"min":{"1min":7,"5min":6.7720000000000002,"15min":6.7720000000000002},"max":{"1min":66.775000000000006,"5min":268.779,"15min":307.334},"last":15.579000000000001}]},{"osd":3,"last update":"Tue Jan 23 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":19.506,"5min":20.187000000000001,"15min":27.277999999999999},"min":{"1min":9.9269999999999996,"5min":7.2489999999999997,"15min":7.2489999999999997},"max":{"1min":67.596999999999994,"5min":108.986,"15min":412.625},"last":17.015999999999998},{"interface":"front","average":{"1min":19.526,"5min":20.641999999999999,"15min":25.834},"min":{"1min":7.6539999999999999,"5min":7.306,"15min":7.1660000000000004},"max":{"1min":74.679000000000002,"5min":115.22499999999999,"15min":253.58199999999999},"last":14.946}]},{"osd":4,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":20.035,"5min":20.260000000000002,"15min":23.454999999999998},"min":{"1min":7.1840000000000002,"5min":7.1840000000000002,"15min":7.1840000000000002},"max":{"1min":60.408000000000001,"5min":126.482,"15min":224.07400000000001},"last":17.741},{"interface":"front","average":{"1min":24.856999999999999,"5min":24.849,"15min":27.280999999999999},"min":{"1min":11.863,"5min":9.5809999999999995,"15min":9.5809999999999995},"max":{"1min":68.748000000000005,"5min":175.51599999999999,"15min":281.10399999999998},"last":18.327000000000002}]},{"osd":6,"last update":"Tue Jan 23 08:10:37 2024","interfaces":[{"interface":"back","average":{"1min":23.773,"5min":19.492999999999999,"15min":22.969000000000001},"min":{"1min":10.401,"5min":7.5039999999999996,"15min":7.5039999999999996},"max":{"1min":86.870999999999995,"5min":141.524,"15min":338.66300000000001},"last":11.302},{"interface":"front","average":{"1min":25.09,"5min":25.440999999999999,"15min":28.952000000000002},"min":{"1min":10.988,"5min":10.988,"15min":10.442},"max":{"1min":96.606999999999999,"5min":145.38300000000001,"15min":417.69},"last":13.419}]},{"osd":7,"last update":"Tue Jan 23 08:10:02 2024","interfaces":[{"interface":"back","average":{"1min":25.297000000000001,"5min":23.457999999999998,"15min":22.731000000000002},"min":{"1min":12.375,"5min":9.8699999999999992,"15min":7.5039999999999996},"max":{"1min":103.679,"5min":111.083,"15min":244.40100000000001},"last":16.355},{"interface":"front","average":{"1min":18.907,"5min":20.039000000000001,"15min":21.625},"min":{"1min":6.3700000000000001,"5min":6.3700000000000001,"15min":6.3700000000000001},"max":{"1min":67.561000000000007,"5min":112.648,"15min":252.24000000000001},"last":12.645}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-23T08:10:56.193 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-23T08:10:56.296 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.291+0000 7fc5fc8a7640 10 monclient: get_monmap_and_config 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.291+0000 7fc5fc8a7640 10 monclient: build_initial_monmap 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.291+0000 7fc5fc8a7640 10 monclient: monmap: 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T08:10:56.292480+0000 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T08:10:56.292480+0000 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:0: v1:172.21.15.116:6789/0 mon.noname-a-legacy 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:1: v1:172.21.15.173:6789/0 mon.noname-c-legacy 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-b 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:3: v2:172.21.15.116:3300/0 mon.noname-a 2024-01-23T08:10:56.297 INFO:teuthology.orchestra.run.smithi116.stderr:4: v2:172.21.15.173:3300/0 mon.noname-c 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.291+0000 7fc5fc8a7640 1 Processor -- start 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.291+0000 7fc5fc8a7640 1 -- start start 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.291+0000 7fc5fc8a7640 10 monclient: init 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient: _add_conns ranks=[1,2,0,4,3] 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient(hunting): picked mon.noname-c-legacy con 0x7fc5f806b240 addr v1:172.21.15.173:6789/0 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f806c530 0x7fc5f806b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f806c530 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fc5f8142550 addr v1:172.21.15.116:6789/0 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 1 -- --> v1:172.21.15.116:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f806d850 con 0x7fc5f8142550 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 1 -- --> v1:172.21.15.173:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f806c0e0 con 0x7fc5f806b240 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:56.298 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f8142030 con 0x7fc5f806c530 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.292+0000 7fc5fc8a7640 10 monclient(hunting): authenticate will time out at 4663.650875s 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.293+0000 7fc5f6d9d640 1 --1- >> v1:172.21.15.116:6789/0 conn(0x7fc5f8142550 0x7fc5f814c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.116:6789/0 says I am v1:172.21.15.116:52836/0 (socket says 172.21.15.116:52836) 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.293+0000 7fc5f6d9d640 1 -- 172.21.15.116:0/2232854124 learned_addr learned my addr 172.21.15.116:0/2232854124 (peer_addr_for_me v1:172.21.15.116:0/0) 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.293+0000 7fc5f5d9b640 1 --2- 172.21.15.116:0/2232854124 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f806c530 0x7fc5f806b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.293+0000 7fc5f5d9b640 10 monclient(hunting): get_auth_request con 0x7fc5f806c530 auth_method 0 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.293+0000 7fc5f5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.293+0000 7fc5f5d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.293+0000 7fc5f5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.294+0000 7fc5f5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.294+0000 7fc5f5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.294+0000 7fc5f5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.295+0000 7fc5f559a640 1 -- 172.21.15.116:0/2232854124 <== mon.1 v1:172.21.15.173:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046525973 0 0) 0x7fc5f806c0e0 con 0x7fc5f806b240 2024-01-23T08:10:56.299 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.295+0000 7fc5f559a640 10 monclient(hunting): _negotiate 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.295+0000 7fc5f559a640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.295+0000 7fc5f559a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.295+0000 7fc5f559a640 10 monclient(hunting): my global_id is 21004 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.295+0000 7fc5f559a640 1 -- 172.21.15.116:0/2232854124 --> v1:172.21.15.173:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e0003520 con 0x7fc5f806b240 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f559a640 1 -- 172.21.15.116:0/2232854124 <== mon.0 v1:172.21.15.116:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390236740 0 0) 0x7fc5f806d850 con 0x7fc5f8142550 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f559a640 10 monclient(hunting): _negotiate 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f559a640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f559a640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f559a640 10 monclient(hunting): my global_id is 16629 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f559a640 1 -- 172.21.15.116:0/2232854124 --> v1:172.21.15.116:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f806c0e0 con 0x7fc5f8142550 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 10 monclient(hunting): handle_auth_done global_id 28502 payload 274 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 1 -- 172.21.15.116:0/2232854124 >> v1:172.21.15.173:6789/0 conn(0x7fc5f806b240 legacy=0x7fc5f813f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 1 -- 172.21.15.116:0/2232854124 >> v1:172.21.15.116:6789/0 conn(0x7fc5f8142550 legacy=0x7fc5f814c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.300 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 10 monclient: _finish_hunting 0 2024-01-23T08:10:56.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 1 monclient: found mon.noname-b 2024-01-23T08:10:56.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:56.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.116:3301/0 2024-01-23T08:10:56.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.296+0000 7fc5f5d9b640 1 -- 172.21.15.116:0/2232854124 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f813fb10 con 0x7fc5f806c530 2024-01-23T08:10:56.301 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.298+0000 7fc5f5d9b640 1 --2- 172.21.15.116:0/2232854124 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f806c530 0x7fc5f806b620 secure :-1 s=READY pgs=3337 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0097d0 tx=0x7fc5ec02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98469a54a5648350 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 1 -- 172.21.15.116:0/2232854124 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec031800 con 0x7fc5f806c530 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: dump: 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:56.303 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: _finish_auth 0 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: _check_auth_tickets 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 1 -- 172.21.15.116:0/2232854124 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec031960 con 0x7fc5f806c530 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 5 monclient: authenticate success, global_id 28502 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 1 -- 172.21.15.116:0/2232854124 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec031cf0 con 0x7fc5f806c530 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 10 monclient: get_monmap_and_config success 2024-01-23T08:10:56.304 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 4 set_mon_vals no callback set 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5f559a640 10 monclient: dump: 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:56.305 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 10 monclient: shutdown 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/2232854124 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f806c530 msgr2=0x7fc5f806b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.302+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/2232854124 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f806c530 0x7fc5f806b620 secure :-1 s=READY pgs=3337 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0097d0 tx=0x7fc5ec02b8a0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.303+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/2232854124 shutdown_connections 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.303+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/2232854124 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f806c530 0x7fc5f806b620 unknown :-1 s=CLOSED pgs=3337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.303+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/2232854124 >> 172.21.15.116:0/2232854124 conn(0x7fc5f80b28a0 msgr2=0x7fc5f80b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.303+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/2232854124 shutdown_connections 2024-01-23T08:10:56.306 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.303+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/2232854124 wait complete. 2024-01-23T08:10:56.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.303+0000 7fc5fc8a7640 10 monclient: build_initial_monmap 2024-01-23T08:10:56.309 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.303+0000 7fc5fc8a7640 10 monclient: monmap: 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 0 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 0.000000 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:created 0.000000 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 0 (unknown) 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.noname-a 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.noname-b 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.noname-c 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 librados: starting msgr at 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 librados: starting objecter 2024-01-23T08:10:56.310 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 Processor -- start 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 -- start start 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 librados: setting wanted keys 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 librados: calling monclient init 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient: init 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient: _reopen_session rank -1 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient: _add_conns ranks=[0,1,2] 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5f806b240 0x7fc5f81daac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): picked mon.noname-a con 0x7fc5f806b240 addr [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5f806c530 0x7fc5f81db000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): picked mon.noname-b con 0x7fc5f806c530 addr [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f8142550 0x7fc5f8133ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): picked mon.noname-c con 0x7fc5f8142550 addr [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:56.311 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80b0e10 con 0x7fc5f806b240 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f806f770 con 0x7fc5f806c530 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): start opening mon connection 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 1 -- --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f80b12a0 con 0x7fc5f8142550 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): _renew_subs 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.304+0000 7fc5fc8a7640 10 monclient(hunting): authenticate will time out at 4663.663149s 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f6d9d640 1 --2- >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f8142550 0x7fc5f8133ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5f806b240 0x7fc5f81daac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f5d9b640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5f806c530 0x7fc5f81db000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f659c640 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5f806b240 0x7fc5f81daac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:37222/0 (socket says 172.21.15.116:37222) 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f659c640 1 -- 172.21.15.116:0/3104077750 learned_addr learned my addr 172.21.15.116:0/3104077750 (peer_addr_for_me v2:172.21.15.116:0/0) 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f659c640 10 monclient(hunting): get_auth_request con 0x7fc5f806b240 auth_method 0 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f659c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:56.312 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f659c640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f659c640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f6d9d640 10 monclient(hunting): get_auth_request con 0x7fc5f8142550 auth_method 0 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f6d9d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f6d9d640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f6d9d640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f5d9b640 10 monclient(hunting): get_auth_request con 0x7fc5f806c530 auth_method 0 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f5d9b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f5d9b640 10 monclient(hunting): _init_auth method 2 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.305+0000 7fc5f5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f659c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f659c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f659c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f6d9d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f6d9d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:56.313 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f6d9d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f5d9b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f5d9b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.306+0000 7fc5f5d9b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 10 monclient(hunting): handle_auth_done global_id 28505 payload 824 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 1 -- 172.21.15.116:0/3104077750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5f806c530 msgr2=0x7fc5f81db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5f806c530 0x7fc5f81db000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 1 -- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5f806b240 msgr2=0x7fc5f81daac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5f806b240 0x7fc5f81daac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 10 monclient: _finish_hunting 0 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 1 monclient: found mon.noname-c 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.116:3301/0 2024-01-23T08:10:56.314 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f6d9d640 1 -- 172.21.15.116:0/3104077750 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009400 con 0x7fc5f8142550 2024-01-23T08:10:56.315 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.309+0000 7fc5f659c640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5f806b240 0x7fc5f81daac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.311+0000 7fc5f6d9d640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f8142550 0x7fc5f8133ab0 secure :-1 s=READY pgs=3338 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000c370 tx=0x7fc5f0001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.311+0000 7fc5e6ffd640 10 client.?.objecter ms_handle_connect 0x7fc5f8142550 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.311+0000 7fc5e6ffd640 10 client.?.objecter resend_mon_ops 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.314+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0005da0 con 0x7fc5f8142550 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.314+0000 7fc5e6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.314+0000 7fc5e6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.314+0000 7fc5e6ffd640 10 monclient: dump: 2024-01-23T08:10:56.316 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 10 monclient: _finish_auth 0 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 10 monclient: _check_auth_tickets 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f00070d0 con 0x7fc5f8142550 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 5 monclient: authenticate success, global_id 28505 2024-01-23T08:10:56.317 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 10 monclient: _renew_subs 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f806fa50 con 0x7fc5f8142550 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 10 monclient: handle_config config(0 keys) v1 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f0007440 con 0x7fc5f8142550 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5e6ffd640 10 monclient: dump: 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:epoch 1 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:fsid 6d11e51e-733b-4e2c-8640-454d4ffd488c 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:last_changed 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:created 2024-01-23T07:31:38.694528+0000 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:min_mon_release 19 (squid) 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:election_strategy: 1 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:0: [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon.a 2024-01-23T08:10:56.318 INFO:teuthology.orchestra.run.smithi116.stderr:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2: [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] mon.c 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5f4d99640 4 set_mon_vals no callback set 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 10 client.28505.objecter _maybe_request_map subscribing (onetime) to next osd map 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 10 monclient: _renew_subs 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f8134cc0 con 0x7fc5f8142550 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 1 librados: init done 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.315+0000 7fc5fc8a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.316+0000 7fc5fc8a7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:56.319 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.316+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f80b0fc0 con 0x7fc5f8142550 2024-01-23T08:10:56.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.334+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 4 ==== mgrmap(e 5) v1 ==== 89206+0+0 (secure 0 0 0) 0x7fc5f00075a0 con 0x7fc5f8142550 2024-01-23T08:10:56.334 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.334+0000 7fc5e6ffd640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5d806c890 0x7fc5d806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-23T08:10:56.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.335+0000 7fc5f659c640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5d806c890 0x7fc5d806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-23T08:10:56.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.335+0000 7fc5f659c640 10 monclient: get_auth_request con 0x7fc5d806c890 auth_method 0 2024-01-23T08:10:56.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.335+0000 7fc5f659c640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5d806c890 0x7fc5d806ed50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800f370 tx=0x7fc5e8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-23T08:10:56.335 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.335+0000 7fc5e6ffd640 10 client.28505.objecter ms_handle_connect 0x7fc5d806c890 2024-01-23T08:10:56.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.336+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 5 ==== osd_map(1323..1323 src has 1032..1323) v4 ==== 6366+0+0 (secure 0 0 0) 0x7fc5f0057a60 con 0x7fc5f8142550 2024-01-23T08:10:56.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.336+0000 7fc5e6ffd640 10 client.28505.objecter ms_dispatch 0x7fc5f8000b90 osd_map(1323..1323 src has 1032..1323) v4 2024-01-23T08:10:56.336 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.336+0000 7fc5e6ffd640 3 client.28505.objecter handle_osd_map got epochs [1323,1323] > 0 2024-01-23T08:10:56.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.336+0000 7fc5e6ffd640 3 client.28505.objecter handle_osd_map decoding full epoch 1323 2024-01-23T08:10:56.337 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.336+0000 7fc5e6ffd640 20 client.28505.objecter dump_active .. 0 homeless 2024-01-23T08:10:56.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.569+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180608 (secure 0 0 0) 0x7fc5f0053da0 con 0x7fc5f8142550 2024-01-23T08:10:56.569 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.569+0000 7fc5e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-01-23T08:10:56.570 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.569+0000 7fc5e6ffd640 10 monclient: _finish_command 1 = system:0 2024-01-23T08:10:56.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.757+0000 7fc5fc8a7640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-01-23T08:10:56.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.757+0000 7fc5fc8a7640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-01-23T08:10:56.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.757+0000 7fc5fc8a7640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.116:3301/0 2024-01-23T08:10:56.757 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.757+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 --> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fc5f80b0fc0 con 0x7fc5f8142550 2024-01-23T08:10:56.929 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.929+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc5f0053da0 con 0x7fc5f8142550 2024-01-23T08:10:56.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.929+0000 7fc5e6ffd640 10 monclient: handle_config config(1 keys) v1 2024-01-23T08:10:56.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.929+0000 7fc5f4d99640 4 set_mon_vals no callback set 2024-01-23T08:10:56.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.929+0000 7fc5f4d99640 10 set_mon_vals mon_health_to_clog = false 2024-01-23T08:10:56.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.929+0000 7fc5e6ffd640 1 -- 172.21.15.116:0/3104077750 <== mon.2 v2:172.21.15.116:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v5)=0 v5) v1 ==== 123+0+0 (secure 0 0 0) 0x7fc5f80b0fc0 con 0x7fc5f8142550 2024-01-23T08:10:56.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.929+0000 7fc5e6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-01-23T08:10:56.930 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.929+0000 7fc5e6ffd640 10 monclient: _finish_command 2 = system:0 2024-01-23T08:10:56.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 10 librados: watch_flush enter 2024-01-23T08:10:56.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 10 librados: watch_flush exit 2024-01-23T08:10:56.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 20 client.28505.objecter shutdown clearing up homeless session... 2024-01-23T08:10:56.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 10 client.28505.objecter successfully canceled tick 2024-01-23T08:10:56.931 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5d806c890 msgr2=0x7fc5d806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5d806c890 0x7fc5d806ed50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800f370 tx=0x7fc5e8009040 comp rx=0 tx=0).stop 2024-01-23T08:10:56.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 10 monclient: shutdown 2024-01-23T08:10:56.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-01-23T08:10:56.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f8142550 msgr2=0x7fc5f8133ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-23T08:10:56.932 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.931+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f8142550 0x7fc5f8133ab0 secure :-1 s=READY pgs=3338 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000c370 tx=0x7fc5f0001e70 comp rx=0 tx=0).stop 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 shutdown_connections 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:6800/2950757295,v1:172.21.15.116:6801/2950757295] conn(0x7fc5d806c890 0x7fc5d806ed50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3301/0,v1:172.21.15.116:6790/0] conn(0x7fc5f8142550 0x7fc5f8133ab0 unknown :-1 s=CLOSED pgs=3338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5f806c530 0x7fc5f81db000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 --2- 172.21.15.116:0/3104077750 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc5f806b240 0x7fc5f81daac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 >> 172.21.15.116:0/3104077750 conn(0x7fc5f80b28a0 msgr2=0x7fc5f8138260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 shutdown_connections 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 -- 172.21.15.116:0/3104077750 wait complete. 2024-01-23T08:10:56.933 INFO:teuthology.orchestra.run.smithi116.stderr:2024-01-23T08:10:56.932+0000 7fc5fc8a7640 1 librados: shutdown 2024-01-23T08:10:56.944 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-23T08:10:56.944 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-23T08:10:56.944 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-23T08:10:56.944 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:10:56.956 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T08:10:56.948+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 34842) UID: 0 2024-01-23T08:10:56.957 INFO:tasks.ceph.osd.0.smithi116.stderr:2024-01-23T08:10:56.949+0000 b67d640 -1 osd.0 1323 *** Got signal Terminated *** 2024-01-23T08:11:06.042 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:54.421 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.094 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:54.474 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.095 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:54.431 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.100 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:54.437 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.118 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:54.455 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.119 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:54.498 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.141 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:54.520 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.143 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:54.523 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:06.161 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:54.541 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.053 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:59.433 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.102 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:59.481 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.104 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:59.440 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.109 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:59.445 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.123 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:38:59.459 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.138 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:38:59.517 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.154 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:59.533 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.155 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:59.535 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:11.166 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:38:59.546 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.152 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:14.532 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.157 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:14.537 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.171 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:14.551 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.203 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:14.582 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.206 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:14.543 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.207 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:14.587 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.208 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:14.544 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.222 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:14.558 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:26.223 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:14.603 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.169 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:19.548 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.174 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:19.554 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.188 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:19.568 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.222 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:19.601 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.225 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:19.561 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.225 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:19.605 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.227 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:19.564 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.236 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:19.616 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:31.239 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:19.575 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:33.555 INFO:tasks.ceph.osd.0:Stopped 2024-01-23T08:11:33.555 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-23T08:11:33.556 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:11:33.569 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T08:11:33.560+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 34852) UID: 0 2024-01-23T08:11:33.569 INFO:tasks.ceph.osd.1.smithi116.stderr:2024-01-23T08:11:33.561+0000 b67d640 -1 osd.1 1325 *** Got signal Terminated *** 2024-01-23T08:11:37.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-01-23T08:11:39.657 INFO:tasks.ceph.osd.1:Stopped 2024-01-23T08:11:39.657 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-23T08:11:39.657 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:11:39.675 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T08:11:39.663+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 34856) UID: 0 2024-01-23T08:11:39.675 INFO:tasks.ceph.osd.2.smithi116.stderr:2024-01-23T08:11:39.664+0000 b67d640 -1 osd.2 1327 *** Got signal Terminated *** 2024-01-23T08:11:41.232 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:29.611 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.234 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:29.613 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.248 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:29.627 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.276 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:29.612 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.278 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:29.658 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.278 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:29.614 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.279 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:29.659 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.293 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:29.629 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:41.293 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:29.673 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:43.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-01-23T08:11:51.238 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:39.617 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.240 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:39.620 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.255 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:39.635 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.281 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:39.660 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.287 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:39.666 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.292 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:39.629 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.296 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:39.632 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.305 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:39.684 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:51.309 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:39.646 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:11:55.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-01-23T08:11:57.963 INFO:tasks.ceph.osd.2:Stopped 2024-01-23T08:11:57.963 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-23T08:11:57.963 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:11:57.976 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T08:11:57.967+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 34858) UID: 0 2024-01-23T08:11:57.976 INFO:tasks.ceph.osd.3.smithi116.stderr:2024-01-23T08:11:57.969+0000 b67d640 -1 osd.3 1329 *** Got signal Terminated *** 2024-01-23T08:12:01.261 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:49.641 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.264 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:49.644 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.282 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:49.661 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.312 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:49.692 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.313 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:49.649 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.314 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:49.650 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.314 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:49.694 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.331 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:49.711 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.333 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:49.670 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:01.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-01-23T08:12:01.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-01-23T08:12:04.065 INFO:tasks.ceph.osd.3:Stopped 2024-01-23T08:12:04.065 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-23T08:12:04.065 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:12:04.078 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T08:12:04.070+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 34829) UID: 0 2024-01-23T08:12:04.078 INFO:tasks.ceph.osd.4.smithi173.stderr:2024-01-23T08:12:04.071+0000 b67d640 -1 osd.4 1331 *** Got signal Terminated *** 2024-01-23T08:12:07.534 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-01-23T08:12:07.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-01-23T08:12:10.167 INFO:tasks.ceph.osd.4:Stopped 2024-01-23T08:12:10.167 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-23T08:12:10.167 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:12:10.181 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T08:12:10.172+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 34832) UID: 0 2024-01-23T08:12:10.183 INFO:tasks.ceph.osd.5.smithi173.stderr:2024-01-23T08:12:10.173+0000 b67d640 -1 osd.5 1333 *** Got signal Terminated *** 2024-01-23T08:12:11.415 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:59.794 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.421 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:59.801 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.441 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:39:59.821 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.463 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:59.799 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.467 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:59.847 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.467 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:59.803 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.469 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:59.849 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.484 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:39:59.864 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:11.486 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:39:59.822 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:13.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-01-23T08:12:21.323 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:09.702 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.327 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:09.707 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.343 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:09.723 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.372 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:09.709 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.375 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:09.755 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.377 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:09.713 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.378 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:09.758 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.392 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:09.728 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:21.392 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:09.772 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.349 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:19.728 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.351 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:19.731 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.365 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:19.745 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.396 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:19.733 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.400 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:19.779 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.400 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:19.736 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.403 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:19.783 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.413 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:19.750 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:31.416 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:19.796 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.394 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:29.773 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.398 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:29.778 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.422 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:29.802 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.441 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:29.778 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.444 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:29.781 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.451 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:29.831 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.454 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:29.834 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.457 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:29.794 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:41.468 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:29.848 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.375 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:39.755 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.421 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:39.757 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.422 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:39.758 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.424 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:39.803 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.440 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:39.776 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.447 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:39.826 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.472 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:39.852 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.474 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:39.854 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:51.490 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:39.869 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:12:58.978 INFO:tasks.ceph.osd.5:Stopped 2024-01-23T08:12:58.978 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-23T08:12:58.978 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:12:58.992 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T08:12:58.983+0000 b67d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 34833) UID: 0 2024-01-23T08:12:58.993 INFO:tasks.ceph.osd.6.smithi173.stderr:2024-01-23T08:12:58.984+0000 b67d640 -1 osd.6 1335 *** Got signal Terminated *** 2024-01-23T08:13:01.456 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:49.836 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.460 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:49.839 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.473 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:49.853 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.504 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:49.840 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.506 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:49.842 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.509 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:49.889 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.511 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:49.891 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.517 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:49.853 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:01.523 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:49.902 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.499 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:59.879 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.502 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:59.882 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.523 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:40:59.902 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.547 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:59.883 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.550 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:59.887 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.556 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:59.936 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.557 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:59.937 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.572 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:40:59.909 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:11.574 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:40:59.954 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.539 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:09.919 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.544 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:09.924 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.567 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:09.947 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.591 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:09.928 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.593 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:09.930 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.600 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:09.980 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.605 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:09.985 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.609 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:09.945 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:21.623 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:10.003 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.551 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:19.930 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.555 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:19.935 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.575 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:19.954 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.601 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:19.981 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.602 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:19.939 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.605 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:19.985 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.611 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:19.947 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.627 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:20.006 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:31.631 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:19.967 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.524 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:24.903 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.571 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:24.950 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.587 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:24.966 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.619 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:24.955 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.620 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:24.957 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.632 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:25.012 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.633 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:24.969 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.637 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:25.016 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:36.649 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:25.029 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.349 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:27.728 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.352 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:27.731 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.366 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:27.745 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.403 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:27.739 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.403 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:27.783 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.404 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:27.740 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.404 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:27.784 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.418 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:27.754 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:39.418 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:27.798 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.627 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:45.006 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.633 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:45.012 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.651 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:45.030 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.677 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:45.013 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.679 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:45.016 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.682 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:45.062 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.684 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:45.064 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.696 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:45.033 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:56.703 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:45.083 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.381 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:45.717 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.382 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:45.718 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.390 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:41:45.727 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.403 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:45.783 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.404 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:45.784 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.413 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:41:45.792 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.415 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:45.795 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.417 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:45.796 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:13:57.425 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:41:45.805 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.690 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:05.069 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.694 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:05.074 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.717 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:05.096 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.744 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:05.081 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.745 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:05.125 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.745 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:05.082 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.748 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:05.128 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.763 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:05.099 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:16.767 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:05.147 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.453 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:05.790 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.454 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:05.791 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.462 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:05.799 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.493 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:05.872 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.495 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:05.874 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.505 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:05.885 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.507 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:05.886 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.508 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:05.887 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:17.516 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:05.896 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:20.510 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:20.506+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:21.483 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:21.482+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:22.447 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:22.446+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:23.426 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:23.421+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:24.377 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:24.376+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:25.370 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:25.369+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:26.371 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:26.371+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:27.394 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:27.394+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:28.408 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:28.407+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:29.401 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:29.399+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:30.409 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:30.408+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:31.420 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:31.418+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:32.408 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:32.407+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:33.404 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:33.403+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:34.453 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:34.453+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:35.491 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:35.490+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:36.487 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:36.486+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:36.749 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:25.129 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.753 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:25.132 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.770 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:25.150 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.798 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:25.178 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.799 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:25.135 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.800 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:25.136 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.803 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:25.183 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.817 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:25.153 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:36.828 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:25.208 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.455 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:37.454+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:37.525 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:25.861 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.526 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:25.862 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.534 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:25.871 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.551 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:25.930 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.552 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:25.932 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.555 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:25.935 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.556 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:25.936 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.562 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:25.941 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:37.566 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:25.946 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:38.464 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:38.463+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:39.425 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:39.424+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:40.470 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:40.469+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:41.515 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:41.514+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:42.551 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:42.550+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:43.588 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:43.588+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:44.544 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:44.543+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:45.584 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:45.583+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:46.605 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:46.605+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:47.649 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:47.649+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:48.621 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:48.620+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:49.662 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:49.661+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:50.669 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:50.668+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:51.656 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:51.655+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:52.706 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:52.705+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:53.754 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:53.754+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:54.774 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:54.773+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:55.779 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:55.778+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:56.796 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:56.796+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:56.813 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:45.192 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.814 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:45.193 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.832 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:45.212 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.856 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:45.192 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.859 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:45.195 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.866 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:45.246 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.868 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:45.248 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.877 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:45.213 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:56.887 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:45.267 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.573 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:45.910 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.574 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:45.911 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.582 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:42:45.919 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.620 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:46.000 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.621 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:46.001 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.625 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:46.005 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.627 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:46.006 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.631 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:42:46.010 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.635 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:42:46.015 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:14:57.823 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:57.821+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:58.841 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:58.840+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:14:59.834 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:14:59.833+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:00.875 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:00.875+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:01.849 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:01.847+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:02.849 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:02.847+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:03.845 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:03.843+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:04.806 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:04.804+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:05.758 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:05.757+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:06.759 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:06.758+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:07.743 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:07.742+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:08.772 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:08.771+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:09.790 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:09.789+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:10.818 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:10.817+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:11.799 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:11.798+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:12.830 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:12.829+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:13.825 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:13.825+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:14.833 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:14.832+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:15.810 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:15.809+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:16.831 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:16.830+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:16.868 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:05.247 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.869 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:05.249 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.886 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:05.265 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.918 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:05.298 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.919 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:05.255 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.920 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:05.256 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.920 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:05.300 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.937 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:05.273 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:16.940 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:05.319 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.651 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:05.987 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.652 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:05.989 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.660 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:05.997 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.664 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:06.044 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.666 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:06.046 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.674 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:06.053 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.675 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:06.054 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.676 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:06.056 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.682 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:06.062 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:17.800 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:17.800+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:18.765 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:18.764+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:19.771 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:19.770+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:20.789 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:20.789+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:21.751 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:21.750+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:22.749 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:22.748+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:23.707 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:23.707+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:24.674 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:24.674+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:25.691 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:25.690+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:26.721 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:26.720+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:27.681 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:27.680+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:28.705 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:28.704+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:29.670 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:29.669+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:30.624 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:30.623+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:31.580 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:31.580+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:32.561 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:32.560+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:33.604 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:33.602+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:34.634 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:34.634+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:35.667 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:35.666+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:36.653 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:36.651+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:36.925 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:25.305 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:36.927 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:25.307 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:36.945 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:25.324 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:36.978 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:25.314 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:36.979 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:25.315 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:36.992 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:25.372 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:36.993 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:25.373 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:36.996 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:25.332 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.011 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:25.391 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.656 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:37.655+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:37.715 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:26.052 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.716 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:26.053 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.724 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:26.061 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.742 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:26.122 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.743 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:26.123 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.752 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:26.132 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.754 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:26.134 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.755 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:26.135 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:37.763 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:26.143 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:38.706 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:38.705+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:39.663 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:39.662+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:40.632 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:40.631+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:41.619 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:41.618+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:42.580 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:42.580+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:43.597 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:43.596+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:44.550 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:44.550+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:45.536 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:45.535+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:46.503 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:46.502+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:47.468 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:47.467+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:48.459 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:48.457+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:49.487 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:49.485+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:50.438 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:50.438+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:51.416 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:51.415+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:52.389 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:52.388+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:53.385 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:53.384+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:54.397 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:54.395+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:55.430 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:55.429+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:56.446 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:56.446+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:56.983 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:45.363 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:56.986 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:45.365 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.007 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:45.387 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.033 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:45.369 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.035 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:45.371 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.035 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:45.415 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.040 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:45.419 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.053 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:45.390 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.059 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:45.439 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.422 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:57.422+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:57.775 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:46.111 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.776 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:46.113 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.784 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:43:46.121 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.800 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:46.180 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.801 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:46.181 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.811 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:43:46.189 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.823 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:46.202 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.824 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:46.203 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:57.831 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:43:46.211 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:15:58.445 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:58.444+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:15:59.417 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:15:59.416+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:00.467 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:00.466+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:01.487 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:01.485+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:02.470 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:02.470+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:03.449 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:03.449+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:04.419 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:04.418+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:05.394 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:05.393+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:06.430 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:06.429+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:07.478 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:07.478+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:08.529 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:08.528+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:09.569 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:09.568+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:10.564 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:10.562+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:11.597 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:11.596+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:12.579 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:12.578+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:13.622 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:13.622+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:14.640 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:14.639+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:15.622 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:15.621+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:16.581 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:16.580+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:17.044 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:05.423 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.046 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:05.426 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.067 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:05.447 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.096 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:05.476 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.097 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:05.432 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.098 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:05.434 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.099 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:05.479 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.117 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:05.497 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.118 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:05.453 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.600 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:17.600+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:17.841 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:06.178 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.842 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:06.179 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.850 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:06.187 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.862 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:06.241 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.863 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:06.242 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.873 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:06.252 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.875 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:06.255 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.876 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:06.256 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:17.885 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:06.265 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:18.614 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:18.613+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:19.567 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:19.566+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:20.546 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:20.545+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:21.508 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:21.507+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:22.518 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:22.517+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:23.479 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:23.478+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:24.528 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:24.527+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:25.551 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:25.549+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:26.508 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:26.507+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:27.496 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:27.496+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:28.487 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:28.486+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:29.450 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:29.449+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:30.500 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:30.498+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:31.500 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:31.497+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:32.537 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:32.535+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:33.572 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:33.572+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:34.589 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:34.589+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:35.598 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:35.597+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:36.579 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:36.578+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:37.108 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:25.487 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.114 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:25.494 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.140 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:25.520 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.161 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:25.497 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.164 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:25.500 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.167 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:25.547 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.170 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:25.550 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.182 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:25.519 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.191 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:25.571 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.578 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:37.577+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:37.859 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:26.195 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.860 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:26.196 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.866 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:26.246 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.867 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:26.247 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.867 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:26.204 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.881 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:26.260 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.887 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:26.267 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.888 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:26.268 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:37.915 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:26.295 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:38.608 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:38.607+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:39.621 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:39.619+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:40.636 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:40.635+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:41.606 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:41.605+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:42.619 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:42.619+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:43.638 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:43.638+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:44.637 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:44.636+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:45.636 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:45.636+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:46.621 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:46.620+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:47.584 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:47.583+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:48.546 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:48.545+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:49.515 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:49.514+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:50.524 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:50.523+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:51.570 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:51.569+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:52.530 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:52.529+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:53.482 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:53.482+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:54.459 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:54.458+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:55.459 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:55.459+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:56.494 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:56.493+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:57.183 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:45.563 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.188 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:45.567 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.207 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:45.587 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.234 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:45.613 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.237 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:45.574 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.238 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:45.618 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.239 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:45.575 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.257 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:45.637 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.258 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:45.595 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.505 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:57.504+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:57.943 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:46.276 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.943 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:46.277 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.949 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:46.285 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.954 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:46.333 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.955 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:46.334 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.963 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:46.342 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.978 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:46.358 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.979 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:46.359 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:57.987 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:46.367 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.550 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:58.550+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:16:58.648 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:46.984 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.649 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:46.985 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.662 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:44:46.999 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.764 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:47.143 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.767 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:47.144 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.779 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:44:47.159 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.783 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:47.162 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.784 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:47.164 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:58.806 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:44:47.186 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:16:59.524 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:16:59.524+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:00.485 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:00.484+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:01.457 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:01.456+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:02.412 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:02.412+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:03.458 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:03.457+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:04.462 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:04.461+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:05.489 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:05.489+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:06.461 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:06.461+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:07.475 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:07.475+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:08.505 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:08.504+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:09.522 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:09.522+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:10.546 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:10.546+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:11.531 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:11.530+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:12.560 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:12.559+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:13.531 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:13.530+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:14.510 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:14.508+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:15.516 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:15.513+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:16.546 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:16.543+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:17.241 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:05.620 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.243 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:05.622 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.262 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:05.641 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.288 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:05.625 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.292 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:05.628 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.295 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:05.675 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.297 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:05.677 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.309 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:05.645 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.314 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:05.694 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.585 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:17.584+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:17.928 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:06.264 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.929 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:06.266 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.938 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:06.274 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.942 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:06.321 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.943 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:06.323 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.955 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:06.334 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.956 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:06.336 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.957 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:06.337 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:17.966 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:06.346 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:18.586 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:18.586+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:19.637 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:19.636+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:20.675 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:20.673+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:21.709 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:21.708+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:22.697 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:22.696+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:23.685 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:23.685+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:24.704 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:24.703+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:25.744 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:25.743+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:26.750 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:26.750+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:27.730 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:27.729+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:28.703 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:28.702+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:29.728 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:29.727+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:30.775 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:30.774+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:31.797 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:31.796+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:32.826 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:32.826+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:33.859 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:33.858+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:34.908 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:34.907+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:35.863 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:35.862+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:36.883 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:36.882+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:37.300 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:25.680 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.305 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:25.684 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.324 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:25.704 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.350 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:25.686 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.352 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:25.732 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.353 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:25.690 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.356 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:25.735 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.372 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:25.708 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.374 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:25.754 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:37.898 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:37.897+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:38.042 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:26.422 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.043 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:26.423 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.052 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:26.432 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.060 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:26.396 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.061 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:26.398 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.070 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:26.407 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.081 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:26.461 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.082 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:26.462 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.097 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:26.477 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:38.945 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:38.944+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:39.955 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:39.954+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:40.970 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:40.969+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:41.988 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:41.986+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:43.002 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:43.001+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:43.997 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:43.996+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:45.006 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:45.005+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:46.011 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:46.011+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:47.030 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:47.029+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:48.046 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:48.044+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:49.044 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:49.043+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:50.086 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:50.085+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:51.125 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:51.124+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:52.097 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:52.096+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:53.096 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:53.095+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:54.051 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:54.050+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:55.080 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:55.080+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:56.119 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:56.117+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:57.105 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:57.103+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:57.353 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:45.690 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.354 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:45.733 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.355 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:45.735 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.358 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:45.694 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.376 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:45.756 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.382 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:45.719 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.403 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:45.783 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.406 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:45.786 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:57.424 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:45.803 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.005 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:46.341 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.007 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:46.343 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.016 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:46.352 34303== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.049 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-23T08:17:58.049 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-23T08:17:58.049 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:17:58.050 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T08:17:58.050+0000 7f276edf7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 34559) UID: 0 2024-01-23T08:17:58.051 INFO:tasks.ceph.mgr.y.smithi116.stderr:2024-01-23T08:17:58.050+0000 7f276edf7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-23T08:17:58.068 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:58.068+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:58.076 INFO:tasks.ceph.mgr.y:Stopped 2024-01-23T08:17:58.077 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-23T08:17:58.077 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:17:58.080 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:46.460 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.088 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:46.468 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.101 INFO:tasks.ceph.mgr.x:Stopped 2024-01-23T08:17:58.101 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-23T08:17:58.101 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-23T08:17:58.101 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:17:58.102 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:46.481 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.122 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-01-23T08:17:58.110+0000 a176640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 34519) UID: 0 2024-01-23T08:17:58.122 INFO:tasks.ceph.mon.a.smithi116.stderr:2024-01-23T08:17:58.112+0000 a176640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-23T08:17:58.125 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:46.505 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.158 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:46.538 34554== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:58.180 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:46.559 34552== Warning: unimplemented fcntl command: 1036 2024-01-23T08:17:59.035 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:17:59.033+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:17:59.236 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:47.615 34552== 2024-01-23T08:17:59.236 INFO:tasks.ceph.mon.a.smithi116.stderr:==00:00:45:47.615 34552== Exit program on first error (--exit-on-first-error=yes) 2024-01-23T08:17:59.260 INFO:tasks.ceph.mon.a.smithi116.stderr:daemon-helper: command failed with exit status 42 2024-01-23T08:18:00.032 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:00.030+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:01.025 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:01.025+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-01-23T08:18:01.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-01-23T08:18:02.040 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:02.040+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:03.074 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:03.073+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:04.048 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:04.048+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:04.203 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-23T08:18:04.203 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi116 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-01-23T08:18:04.205 INFO:tasks.ceph.mon.a:Stopped 2024-01-23T08:18:04.206 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-23T08:18:04.206 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:18:04.222 INFO:tasks.ceph.mon.c.smithi116.stderr:2024-01-23T08:18:04.210+0000 a176640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 34521) UID: 0 2024-01-23T08:18:04.222 INFO:tasks.ceph.mon.c.smithi116.stderr:2024-01-23T08:18:04.212+0000 a176640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-01-23T08:18:04.779 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:53.159 34554== 2024-01-23T08:18:04.780 INFO:tasks.ceph.mon.c.smithi116.stderr:==00:00:45:53.159 34554== Exit program on first error (--exit-on-first-error=yes) 2024-01-23T08:18:04.803 INFO:tasks.ceph.mon.c.smithi116.stderr:daemon-helper: command failed with exit status 42 2024-01-23T08:18:05.074 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:05.073+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:06.119 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:06.118+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:06.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2024-01-23T08:18:06.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-01-23T08:18:06.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-01-23T08:18:07.110 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:07.109+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:08.127 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:08.126+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:09.154 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:09.153+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:10.115 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:10.114+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:10.307 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-23T08:18:10.308 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi116 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-01-23T08:18:10.308 INFO:tasks.ceph.mon.c:Stopped 2024-01-23T08:18:10.309 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-23T08:18:10.309 INFO:teuthology.orchestra.run:waiting for 300 2024-01-23T08:18:10.328 INFO:tasks.ceph.mon.b.smithi173.stderr:2024-01-23T08:18:10.313+0000 a176640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 34299) UID: 0 2024-01-23T08:18:10.333 INFO:tasks.ceph.mon.b.smithi173.stderr:2024-01-23T08:18:10.315+0000 a176640 -1 mon.b@1(probing) e1 *** Got Signal Terminated *** 2024-01-23T08:18:10.923 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:59.259 34303== 2024-01-23T08:18:10.923 INFO:tasks.ceph.mon.b.smithi173.stderr:==00:00:45:59.259 34303== Exit program on first error (--exit-on-first-error=yes) 2024-01-23T08:18:10.942 INFO:tasks.ceph.mon.b.smithi173.stderr:daemon-helper: command failed with exit status 42 2024-01-23T08:18:11.095 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:11.094+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:11.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~11s 2024-01-23T08:18:11.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-01-23T08:18:11.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-01-23T08:18:12.128 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:12.126+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:13.119 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:13.118+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:14.163 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:14.162+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:15.192 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:15.191+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:16.207 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:16.206+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:16.410 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-01-23T08:18:16.410 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi173 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-01-23T08:18:16.411 INFO:tasks.ceph.mon.b:Stopped 2024-01-23T08:18:16.411 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-23T08:18:16.411 DEBUG:teuthology.orchestra.run.smithi116:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | head -n 1 2024-01-23T08:18:16.633 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T08:18:16.633 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-23T08:18:16.759 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T08:18:16.759 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-23T08:18:16.851 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T08:18:16.851 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-23T08:18:16.925 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T08:18:16.925 DEBUG:teuthology.orchestra.run.smithi116:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-23T08:18:16.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T08:18:16.992 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-23T08:18:17.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~16s 2024-01-23T08:18:17.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-01-23T08:18:17.139 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T08:18:17.139 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-23T08:18:17.163 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:17.162+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:17.210 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T08:18:17.210 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-23T08:18:17.328 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T08:18:17.328 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.389 INFO:teuthology.orchestra.run.smithi173.stderr:umount: /var/lib/ceph/osd/ceph-7: target is busy. 2024-01-23T08:18:17.390 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-23T08:18:17.391 DEBUG:teuthology.orchestra.run.smithi173:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2024-01-23T08:18:17.621 INFO:teuthology.orchestra.run.smithi173.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 597694 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.622 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 21219 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.623 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.624 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 4u a_inode 0,14 0 2081 [eventpoll:5,6,8,9,11,14,15,34,43,44,45,46,52,56,57,60,64,71,72,74,75,76,77,84,85,88,89,104,106,115,129,130...] 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 5u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 6r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 8u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 9u a_inode 0,14 0 2081 [eventpoll:10,13] 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 10r REG 0,20 0 17507 /proc/1/mountinfo 2024-01-23T08:18:17.625 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 11r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 12u netlink 0t0 1216 AUDIT 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 13r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 15u netlink 0t0 1208 KOBJECT_UEVENT 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 16u unix 0xffffa0bb5832c840 0t0 1210 /run/systemd/private type=STREAM (LISTEN) 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 17r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 18u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 19r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 20u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 21u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 22u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 23u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 24u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.626 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 25u unix 0xffffa0bb4307d940 0t0 18696 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 26u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 28u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 29u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 30u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 31u a_inode 0,14 0 2081 bpf-prog 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 32r FIFO 0,13 0t0 137715 pipe 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 33w FIFO 0,13 0t0 137715 pipe 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 34r FIFO 0,13 0t0 137716 pipe 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 35w FIFO 0,13 0t0 137716 pipe 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 36u unix 0xffffa0bb584a8cc0 0t0 135456 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.627 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 43u unix 0xffffa0bb47f43fc0 0t0 17509 /run/systemd/notify type=DGRAM (CONNECTED) 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 44u unix 0xffffa0bb47f4ea40 0t0 17515 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 45u unix 0xffffa0bb47f48000 0t0 17514 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 46u unix 0xffffa0bb47f40880 0t0 17510 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 47u unix 0xffffa0bb47f42640 0t0 17511 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 52u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 55u unix 0xffffa0c1cdb76e80 0t0 19759 /run/udev/control type=SEQPACKET (LISTEN) 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 56r FIFO 0,13 0t0 13897 pipe 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 57u FIFO 0,24 0t0 453 /run/initctl 2024-01-23T08:18:17.628 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 60u unix 0xffffa0bb58329dc0 0t0 1331 type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 64u unix 0xffffa0bb585af700 0t0 24819 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 67u unix 0xffffa0bb47f4cc80 0t0 18882 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 70u unix 0xffffa0bb585ad500 0t0 18870 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 71u unix 0xffffa0bb584ac840 0t0 21390 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 72u unix 0xffffa0bb58392640 0t0 21389 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 74u unix 0xffffa0bb584ac400 0t0 21334 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 75u unix 0xffffa0bb585ae600 0t0 22101 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 76u unix 0xffffa0bb58227700 0t0 21329 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 77u unix 0xffffa0bb584a8880 0t0 16853 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 81u unix 0xffffa0bb58226e80 0t0 2477 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 84u unix 0xffffa0bb47f4c400 0t0 16843 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 85u unix 0xffffa0bb59d7a200 0t0 14061 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 88u unix 0xffffa0bb58395940 0t0 1253 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 89u unix 0xffffa0bb585a8000 0t0 94968 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.629 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 96u unix 0xffffa0bb47f45940 0t0 17522 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 97u unix 0xffffa0bb47f42ec0 0t0 17524 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 98u unix 0xffffa0bb47f4c840 0t0 17526 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 102u netlink 0t0 19761 KOBJECT_UEVENT 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 104u unix 0xffffa0c1cdb73300 0t0 19757 /run/systemd/coredump type=SEQPACKET (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 105u unix 0xffffa0bb5832b300 0t0 1325 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 106u unix 0xffffa0bb58301980 0t0 13900 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 107u unix 0xffffa0bb5832cc80 0t0 1323 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 115u CHR 10,242 0t0 165 /dev/rfkill 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 116u unix 0xffffa0bb58307b40 0t0 13902 /run/rpcbind.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 117u IPv4 13911 0t0 TCP *:sunrpc (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 118u IPv4 1224 0t0 UDP *:sunrpc 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 119u IPv6 16753 0t0 TCP *:sunrpc (LISTEN) 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 128u IPv6 13917 0t0 UDP *:sunrpc 2024-01-23T08:18:17.630 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 129u FIFO 0,24 0t0 447 /run/dmeventd-server 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 1 root 130u FIFO 0,24 0t0 448 /run/dmeventd-client 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:kthreadd 2 root txt unknown /proc/2/exe 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:slub_flus 5 root txt unknown /proc/5/exe 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.631 INFO:teuthology.orchestra.run.smithi173.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:netns 6 root txt unknown /proc/6/exe 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 8 root txt unknown /proc/8/exe 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.632 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 15 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 15 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 15 root txt unknown /proc/15/exe 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:pr/ttyS1 16 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:pr/ttyS1 16 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:pr/ttyS1 16 root txt unknown /proc/16/exe 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_preem 17 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_preem 17 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:rcu_preem 17 root txt unknown /proc/17/exe 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:migration 18 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:migration 18 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.633 INFO:teuthology.orchestra.run.smithi173.stdout:migration 18 root txt unknown /proc/18/exe 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 19 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 19 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 19 root txt unknown /proc/19/exe 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 23 root txt unknown /proc/23/exe 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:migration 24 root txt unknown /proc/24/exe 2024-01-23T08:18:17.634 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 27 root txt unknown /proc/27/exe 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.635 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 29 root txt unknown /proc/29/exe 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:migration 30 root txt unknown /proc/30/exe 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 33 root txt unknown /proc/33/exe 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.636 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 35 root txt unknown /proc/35/exe 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:migration 36 root txt unknown /proc/36/exe 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 39 root txt unknown /proc/39/exe 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2024-01-23T08:18:17.637 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 41 root txt unknown /proc/41/exe 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:migration 42 root txt unknown /proc/42/exe 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 45 root txt unknown /proc/45/exe 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2024-01-23T08:18:17.638 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 47 root txt unknown /proc/47/exe 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:migration 48 root txt unknown /proc/48/exe 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 51 root txt unknown /proc/51/exe 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2024-01-23T08:18:17.639 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 53 root txt unknown /proc/53/exe 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:migration 54 root txt unknown /proc/54/exe 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 57 root txt unknown /proc/57/exe 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.640 INFO:teuthology.orchestra.run.smithi173.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:idle_inje 59 root txt unknown /proc/59/exe 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:migration 60 root txt unknown /proc/60/exe 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 62 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 62 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 62 root txt unknown /proc/62/exe 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 63 root txt unknown /proc/63/exe 2024-01-23T08:18:17.641 INFO:teuthology.orchestra.run.smithi173.stdout:kdevtmpfs 71 root cwd DIR 0,5 3500 1 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:kdevtmpfs 71 root rtd DIR 0,5 3500 1 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:inet_frag 72 root txt unknown /proc/72/exe 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:kauditd 73 root txt unknown /proc/73/exe 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:khungtask 75 root txt unknown /proc/75/exe 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.642 INFO:teuthology.orchestra.run.smithi173.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:oom_reape 76 root txt unknown /proc/76/exe 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:writeback 77 root txt unknown /proc/77/exe 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:kcompactd 78 root txt unknown /proc/78/exe 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:ksmd 79 root txt unknown /proc/79/exe 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:khugepage 81 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:khugepage 81 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:khugepage 81 root txt unknown /proc/81/exe 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:cryptd 82 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.643 INFO:teuthology.orchestra.run.smithi173.stdout:cryptd 82 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:cryptd 82 root txt unknown /proc/82/exe 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:kintegrit 83 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:kintegrit 83 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:kintegrit 83 root txt unknown /proc/83/exe 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:kblockd 84 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:kblockd 84 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:kblockd 84 root txt unknown /proc/84/exe 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:blkcg_pun 85 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:blkcg_pun 85 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:blkcg_pun 85 root txt unknown /proc/85/exe 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:tpm_dev_w 86 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:tpm_dev_w 86 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:tpm_dev_w 86 root txt unknown /proc/86/exe 2024-01-23T08:18:17.644 INFO:teuthology.orchestra.run.smithi173.stdout:md 87 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:md 87 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:md 87 root txt unknown /proc/87/exe 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:md_bitmap 88 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:md_bitmap 88 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:md_bitmap 88 root txt unknown /proc/88/exe 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:edac-poll 89 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:edac-poll 89 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:edac-poll 89 root txt unknown /proc/89/exe 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:watchdogd 90 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:watchdogd 90 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.645 INFO:teuthology.orchestra.run.smithi173.stdout:watchdogd 90 root txt unknown /proc/90/exe 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 92 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 92 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 92 root txt unknown /proc/92/exe 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kswapd0 95 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kswapd0 95 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kswapd0 95 root txt unknown /proc/95/exe 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kthrotld 101 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kthrotld 101 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kthrotld 101 root txt unknown /proc/101/exe 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:acpi_ther 109 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:acpi_ther 109 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:acpi_ther 109 root txt unknown /proc/109/exe 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kmpath_rd 110 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kmpath_rd 110 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.646 INFO:teuthology.orchestra.run.smithi173.stdout:kmpath_rd 110 root txt unknown /proc/110/exe 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kaluad 111 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kaluad 111 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kaluad 111 root txt unknown /proc/111/exe 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:mld 113 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:mld 113 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:mld 113 root txt unknown /proc/113/exe 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 114 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 114 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 114 root txt unknown /proc/114/exe 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:ipv6_addr 115 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:ipv6_addr 115 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:ipv6_addr 115 root txt unknown /proc/115/exe 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kstrp 124 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.647 INFO:teuthology.orchestra.run.smithi173.stdout:kstrp 124 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kstrp 124 root txt unknown /proc/124/exe 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:zswap-shr 130 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:zswap-shr 130 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:zswap-shr 130 root txt unknown /proc/130/exe 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 131 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 131 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 131 root txt unknown /proc/131/exe 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 277 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 277 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 277 root txt unknown /proc/277/exe 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 279 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 279 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 279 root txt unknown /proc/279/exe 2024-01-23T08:18:17.648 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 282 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 282 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 282 root txt unknown /proc/282/exe 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 284 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 284 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 284 root txt unknown /proc/284/exe 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 287 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 287 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 287 root txt unknown /proc/287/exe 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 329 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 329 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 329 root txt unknown /proc/329/exe 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-wq 437 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-wq 437 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.649 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-wq 437 root txt unknown /proc/437/exe 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-rese 438 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-rese 438 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-rese 438 root txt unknown /proc/438/exe 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-dele 439 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-dele 439 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-dele 439 root txt unknown /proc/439/exe 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-auth 440 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-auth 440 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:nvme-auth 440 root txt unknown /proc/440/exe 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:ata_sff 442 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:ata_sff 442 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:ata_sff 442 root txt unknown /proc/442/exe 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:ixgbe 443 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:ixgbe 443 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:ixgbe 443 root txt unknown /proc/443/exe 2024-01-23T08:18:17.650 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_0 449 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_0 449 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_0 449 root txt unknown /proc/449/exe 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 450 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 450 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 450 root txt unknown /proc/450/exe 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_1 451 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_1 451 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_1 451 root txt unknown /proc/451/exe 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 452 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 452 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 452 root txt unknown /proc/452/exe 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_2 453 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.651 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_2 453 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_2 453 root txt unknown /proc/453/exe 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 454 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 454 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 454 root txt unknown /proc/454/exe 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_3 455 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_3 455 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_3 455 root txt unknown /proc/455/exe 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 456 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 456 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 456 root txt unknown /proc/456/exe 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_4 458 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_4 458 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.652 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_4 458 root txt unknown /proc/458/exe 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 459 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 459 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 459 root txt unknown /proc/459/exe 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_5 460 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_5 460 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_5 460 root txt unknown /proc/460/exe 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 461 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 461 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 461 root txt unknown /proc/461/exe 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_6 462 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_6 462 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_6 462 root txt unknown /proc/462/exe 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 463 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.653 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 463 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 463 root txt unknown /proc/463/exe 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_7 464 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_7 464 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_7 464 root txt unknown /proc/464/exe 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 465 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 465 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 465 root txt unknown /proc/465/exe 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_8 466 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_8 466 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_8 466 root txt unknown /proc/466/exe 2024-01-23T08:18:17.654 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 467 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 467 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 467 root txt unknown /proc/467/exe 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_9 468 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_9 468 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_eh_9 468 root txt unknown /proc/468/exe 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 469 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 469 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:scsi_tmf_ 469 root txt unknown /proc/469/exe 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:jbd2/sda1 498 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:jbd2/sda1 498 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.655 INFO:teuthology.orchestra.run.smithi173.stdout:jbd2/sda1 498 root txt unknown /proc/498/exe 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:ext4-rsv- 499 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:ext4-rsv- 499 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:ext4-rsv- 499 root txt unknown /proc/499/exe 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.656 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.657 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 1w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 2w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 3u unix 0xffffa0bb47f42ec0 0t0 17524 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 4u unix 0xffffa0bb47f4c840 0t0 17526 /run/systemd/journal/stdout type=STREAM (LISTEN) 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 5u unix 0xffffa0bb47f45940 0t0 17522 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 6w CHR 1,11 0t0 10 /dev/kmsg 2024-01-23T08:18:17.658 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 7u a_inode 0,14 0 2081 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,22,23,24,25,27,28,29,30,32,33] 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 8u CHR 1,11 0t0 10 /dev/kmsg 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 9u unix 0xffffa0bb584acc80 0t0 2374 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 10r REG 0,20 0 2234 /proc/sys/kernel/hostname 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 11u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 12u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 13u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 14u unix 0xffffa0bb5861f2c0 0t0 2375 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 15u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.659 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 17u unix 0xffffa0bb58395940 0t0 1253 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 18u unix 0xffffa0bb47f4c400 0t0 16843 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 19u unix 0xffffa0bb58226e80 0t0 2477 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 20u unix 0xffffa0bb59d7a200 0t0 14061 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 21u unix 0xffffa0bb585a8000 0t0 94968 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 22u unix 0xffffa0bb584a8880 0t0 16853 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 23u unix 0xffffa0bb58227700 0t0 21329 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 24u unix 0xffffa0bb585ae600 0t0 22101 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 25u unix 0xffffa0bb584a8cc0 0t0 135456 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 27u unix 0xffffa0bb58392640 0t0 21389 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 28u unix 0xffffa0bb584ac400 0t0 21334 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 29u unix 0xffffa0bb584ac840 0t0 21390 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 30u unix 0xffffa0bb585ad500 0t0 18870 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 32u unix 0xffffa0bb47f4cc80 0t0 18882 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-j 575 root 33u unix 0xffffa0bb585af700 0t0 24819 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2024-01-23T08:18:17.660 INFO:teuthology.orchestra.run.smithi173.stdout:ext4lazyi 581 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:ext4lazyi 581 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:ext4lazyi 581 root txt unknown /proc/581/exe 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 597694 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 583944 265288 /usr/lib/modules/5.14.0-410.el9.x86_64/modules.symbols.bin 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 828544 265285 /usr/lib/modules/5.14.0-410.el9.x86_64/modules.alias.bin 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 396873 265294 /usr/lib/modules/5.14.0-410.el9.x86_64/modules.dep.bin 2024-01-23T08:18:17.661 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 21219 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.662 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 11525 265289 /usr/lib/modules/5.14.0-410.el9.x86_64/modules.builtin.bin 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 1u unix 0xffffa0bb58392ec0 0t0 19794 type=STREAM (CONNECTED) 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 2u unix 0xffffa0bb58392ec0 0t0 19794 type=STREAM (CONNECTED) 2024-01-23T08:18:17.663 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 3u unix 0xffffa0c1cdb76e80 0t0 19759 /run/udev/control type=SEQPACKET (LISTEN) 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 4u netlink 0t0 19761 KOBJECT_UEVENT 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 5u unix 0xffffa0c1cdb71100 0t0 19806 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 6u unix 0xffffa0c1cdb77b40 0t0 19810 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 7u unix 0xffffa0c1cdb72a80 0t0 19811 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 9u a_inode 0,14 0 2081 [eventpoll:3,4,6,8,10,11,14] 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 10u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 11u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-u 593 root 14u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:ipmi-msgh 638 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:ipmi-msgh 638 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:ipmi-msgh 638 root txt unknown /proc/638/exe 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:kipmi0 657 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.664 INFO:teuthology.orchestra.run.smithi173.stdout:kipmi0 657 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:kipmi0 657 root txt unknown /proc/657/exe 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.665 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.666 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 1u unix 0xffffa0bb59d7c400 0t0 18819 type=STREAM (CONNECTED) 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 2u unix 0xffffa0bb59d7c400 0t0 18819 type=STREAM (CONNECTED) 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 3u unix 0xffffa0bb58307b40 0t0 13902 /run/rpcbind.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 4u IPv4 13911 0t0 TCP *:sunrpc (LISTEN) 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 5u IPv4 1224 0t0 UDP *:sunrpc 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 6u IPv6 16753 0t0 TCP *:sunrpc (LISTEN) 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 7u IPv6 13917 0t0 UDP *:sunrpc 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpcbind 668 rpc 8rW REG 0,24 0 1083 /run/rpcbind/rpcbind.lock 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpciod 673 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpciod 673 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.667 INFO:teuthology.orchestra.run.smithi173.stdout:rpciod 673 root txt unknown /proc/673/exe 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:xprtiod 674 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:xprtiod 674 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:xprtiod 674 root txt unknown /proc/674/exe 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.668 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 3u netlink 0t0 22074 AUDIT 2024-01-23T08:18:17.669 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 4w REG 8,1 2522382 64146 /var/log/audit/audit.log 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 6u unix 0xffffa0c1cc78c400 0t0 14133 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 7u unix 0xffffa0bb58301100 0t0 14132 type=STREAM (CONNECTED) 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 8u unix 0xffffa0bb58303fc0 0t0 14134 type=STREAM (CONNECTED) 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 9u unix 0xffffa0bb58305500 0t0 14135 type=STREAM (CONNECTED) 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 root 10u a_inode 0,14 0 2081 [eventfd:0] 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.670 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 3u netlink 0t0 22074 AUDIT 2024-01-23T08:18:17.671 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 4w REG 8,1 2522382 64146 /var/log/audit/audit.log 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 6u unix 0xffffa0c1cc78c400 0t0 14133 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 7u unix 0xffffa0bb58301100 0t0 14132 type=STREAM (CONNECTED) 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 8u unix 0xffffa0bb58303fc0 0t0 14134 type=STREAM (CONNECTED) 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 9u unix 0xffffa0bb58305500 0t0 14135 type=STREAM (CONNECTED) 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 676 auditd root 10u a_inode 0,14 0 2081 [eventfd:0] 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.672 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.673 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 3u netlink 0t0 22074 AUDIT 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 4w REG 8,1 2522382 64146 /var/log/audit/audit.log 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 6u unix 0xffffa0c1cc78c400 0t0 14133 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 7u unix 0xffffa0bb58301100 0t0 14132 type=STREAM (CONNECTED) 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 8u unix 0xffffa0bb58303fc0 0t0 14134 type=STREAM (CONNECTED) 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 9u unix 0xffffa0bb58305500 0t0 14135 type=STREAM (CONNECTED) 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:auditd 675 678 auditd root 10u a_inode 0,14 0 2081 [eventfd:0] 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.674 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root 0u unix 0xffffa0bb58303740 0t0 14131 type=STREAM (CONNECTED) 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.675 INFO:teuthology.orchestra.run.smithi173.stdout:sedispatc 677 root 3u unix 0xffffa0bb58397b40 0t0 25082 type=STREAM (CONNECTED) 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus DEL REG 0,1 2048 /memfd:dbus-broker-log 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.676 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 1u unix 0xffffa0bb47f4a200 0t0 22086 type=STREAM (CONNECTED) 2024-01-23T08:18:17.677 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 2u unix 0xffffa0bb47f4a200 0t0 22086 type=STREAM (CONNECTED) 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 3u unix 0xffffa0bb5832cc80 0t0 1323 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 4u unix 0xffffa0bb47f46a40 0t0 22096 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 5u a_inode 0,14 0 2081 [eventpoll:6,7,8,9,10,11] 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 6u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 7r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 8u unix 0xffffa0bb47f4e1c0 0t0 22098 type=STREAM (CONNECTED) 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 9u unix 0xffffa0bb47f4d940 0t0 22100 type=STREAM (CONNECTED) 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 10u a_inode 0,14 0 2081 [pidfd:715] 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 11u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 714 dbus 12u REG 0,1 2097152 2048 /memfd:dbus-broker-log (deleted) 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.678 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 1u unix 0xffffa0bb47f4a200 0t0 22086 type=STREAM (CONNECTED) 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 2u unix 0xffffa0bb47f4a200 0t0 22086 type=STREAM (CONNECTED) 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 3u sock 0,8 0t0 2472 protocol: NETLINK 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 4u unix 0xffffa0bb47f46a40 0t0 22096 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 5u a_inode 0,14 0 2081 [eventpoll:6,7,8,9,10,11,12,13,15,17,18,19] 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 6u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.679 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 7u unix 0xffffa0bb5832cc80 0t0 1323 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 8u unix 0xffffa0bb58329540 0t0 2473 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 9u unix 0xffffa0bb47f4aec0 0t0 22099 type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 10u unix 0xffffa0bb47f4d500 0t0 2475 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 11u unix 0xffffa0bb584a8440 0t0 22107 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 12u unix 0xffffa0bb58220cc0 0t0 22116 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 13u unix 0xffffa0bb5832c400 0t0 18843 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 15u unix 0xffffa0bb5832aec0 0t0 18846 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 17u unix 0xffffa0bb58391980 0t0 25083 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 18u unix 0xffffa0bb5832dd80 0t0 21418 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:dbus-brok 715 dbus 19u unix 0xffffa0bb58300880 0t0 19157 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-01-23T08:18:17.680 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.681 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.682 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.683 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.684 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.685 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 1u unix 0xffffa0bb58224840 0t0 16844 type=STREAM (CONNECTED) 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 2u unix 0xffffa0bb58224840 0t0 16844 type=STREAM (CONNECTED) 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 3u a_inode 0,14 0 2081 [eventfd:6] 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 4u a_inode 0,14 0 2081 [eventfd:7] 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 5u unix 0xffffa0bb58332200 0t0 1375 type=DGRAM (UNCONNECTED) 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 6u unix 0xffffa0bb5832e1c0 0t0 1376 type=STREAM (CONNECTED) 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 7u a_inode 0,14 0 2081 [eventfd:8] 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 8r REG 0,4 0 4026531840 net 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 9r REG 0,4 0 4026532495 mnt 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 10u netlink 0t0 1380 KOBJECT_UEVENT 2024-01-23T08:18:17.686 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 11u netlink 0t0 1381 GENERIC 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 12u netlink 0t0 1382 GENERIC 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 13u netlink 0t0 1383 ROUTE 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 14r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 15r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 16u netlink 0t0 14154 KOBJECT_UEVENT 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 17u a_inode 0,14 0 2081 [eventpoll] 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 18u unix 0xffffa0bb5832a200 0t0 1424 type=STREAM (CONNECTED) 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 19u a_inode 0,14 0 2081 [eventpoll:21,26] 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 20w FIFO 0,24 0t0 1168 /run/systemd/inhibit/1.ref 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 21u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 23u a_inode 0,14 0 2081 [eventpoll:24,25] 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 24u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 25u pack 1466 0t0 ARP type=SOCK_DGRAM 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 root 26u IPv4 1467 0t0 UDP smithi173.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-01-23T08:18:17.687 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.688 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.689 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.690 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.691 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.692 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 1u unix 0xffffa0bb58224840 0t0 16844 type=STREAM (CONNECTED) 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 2u unix 0xffffa0bb58224840 0t0 16844 type=STREAM (CONNECTED) 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 3u a_inode 0,14 0 2081 [eventfd:6] 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 4u a_inode 0,14 0 2081 [eventfd:7] 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 5u unix 0xffffa0bb58332200 0t0 1375 type=DGRAM (UNCONNECTED) 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 6u unix 0xffffa0bb5832e1c0 0t0 1376 type=STREAM (CONNECTED) 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 7u a_inode 0,14 0 2081 [eventfd:8] 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 8r REG 0,4 0 4026531840 net 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 9r REG 0,4 0 4026532495 mnt 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 10u netlink 0t0 1380 KOBJECT_UEVENT 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 11u netlink 0t0 1381 GENERIC 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 12u netlink 0t0 1382 GENERIC 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 13u netlink 0t0 1383 ROUTE 2024-01-23T08:18:17.693 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 14r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 15r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 16u netlink 0t0 14154 KOBJECT_UEVENT 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 17u a_inode 0,14 0 2081 [eventpoll] 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 18u unix 0xffffa0bb5832a200 0t0 1424 type=STREAM (CONNECTED) 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 19u a_inode 0,14 0 2081 [eventpoll:21,26] 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 20w FIFO 0,24 0t0 1168 /run/systemd/inhibit/1.ref 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 21u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 23u a_inode 0,14 0 2081 [eventpoll:24,25] 2024-01-23T08:18:17.695 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 24u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 25u pack 1466 0t0 ARP type=SOCK_DGRAM 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 744 gmain root 26u IPv4 1467 0t0 UDP smithi173.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2024-01-23T08:18:17.696 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.697 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.698 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.699 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2024-01-23T08:18:17.700 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 1u unix 0xffffa0bb58224840 0t0 16844 type=STREAM (CONNECTED) 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 2u unix 0xffffa0bb58224840 0t0 16844 type=STREAM (CONNECTED) 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 3u a_inode 0,14 0 2081 [eventfd:6] 2024-01-23T08:18:17.701 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 4u a_inode 0,14 0 2081 [eventfd:7] 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 5u unix 0xffffa0bb58332200 0t0 1375 type=DGRAM (UNCONNECTED) 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 6u unix 0xffffa0bb5832e1c0 0t0 1376 type=STREAM (CONNECTED) 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 7u a_inode 0,14 0 2081 [eventfd:8] 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 8r REG 0,4 0 4026531840 net 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 9r REG 0,4 0 4026532495 mnt 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 10u netlink 0t0 1380 KOBJECT_UEVENT 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 11u netlink 0t0 1381 GENERIC 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 12u netlink 0t0 1382 GENERIC 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 13u netlink 0t0 1383 ROUTE 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 14r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 15r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 16u netlink 0t0 14154 KOBJECT_UEVENT 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 17u a_inode 0,14 0 2081 [eventpoll] 2024-01-23T08:18:17.702 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 18u unix 0xffffa0bb5832a200 0t0 1424 type=STREAM (CONNECTED) 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 19u a_inode 0,14 0 2081 [eventpoll:21,26] 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 20w FIFO 0,24 0t0 1168 /run/systemd/inhibit/1.ref 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 21u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 23u a_inode 0,14 0 2081 [eventpoll:24,25] 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 24u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 25u pack 1466 0t0 ARP type=SOCK_DGRAM 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:NetworkMa 716 745 gdbus root 26u IPv4 1467 0t0 UDP smithi173.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.703 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root 1u unix 0xffffa0bb584af2c0 0t0 2482 type=STREAM (CONNECTED) 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root 2u unix 0xffffa0bb584af2c0 0t0 2482 type=STREAM (CONNECTED) 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root 3u a_inode 0,14 0 2081 [eventfd:1] 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root 4u a_inode 0,14 0 2081 [eventfd:2] 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root 5u unix 0xffffa0bb58222200 0t0 16862 /run/irqbalance/irqbalance719.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 root 6u unix 0xffffa0bb581a3fc0 0t0 17133 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.704 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root DEL REG 8,1 9998 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root 1u unix 0xffffa0bb584af2c0 0t0 2482 type=STREAM (CONNECTED) 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root 2u unix 0xffffa0bb584af2c0 0t0 2482 type=STREAM (CONNECTED) 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root 3u a_inode 0,14 0 2081 [eventfd:1] 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root 4u a_inode 0,14 0 2081 [eventfd:2] 2024-01-23T08:18:17.705 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root 5u unix 0xffffa0bb58222200 0t0 16862 /run/irqbalance/irqbalance719.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:irqbalanc 719 726 gmain root 6u unix 0xffffa0bb581a3fc0 0t0 17133 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt 1u unix 0xffffa0bb58220440 0t0 16854 type=STREAM (CONNECTED) 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt 2u unix 0xffffa0bb58220440 0t0 16854 type=STREAM (CONNECTED) 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt 3uW REG 0,24 0 1121 /run/lsm/ipc/.lsmd-ipc-lock 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt 5u unix 0xffffa0bb585ab740 0t0 21344 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:lsmd 720 libstoragemgmt 6u unix 0xffffa0bb585a9100 0t0 21345 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.706 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root 1u unix 0xffffa0bb585acc80 0t0 21330 type=STREAM (CONNECTED) 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root 2u unix 0xffffa0bb585acc80 0t0 21330 type=STREAM (CONNECTED) 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root 3r CHR 10,227 0t0 142 /dev/mcelog 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:mcelog 721 root 4u unix 0xffffa0bb585add80 0t0 21343 /var/run/mcelog-client type=STREAM (LISTEN) 2024-01-23T08:18:17.707 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.708 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.709 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.710 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.711 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.712 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 734 gmain polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.713 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.714 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.715 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 735 gdbus polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.716 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.717 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.718 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 736 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.719 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.720 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.721 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 737 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.722 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.723 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.724 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 738 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.725 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.726 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.727 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 739 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.728 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.729 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.730 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 740 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.731 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.732 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.733 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 741 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.734 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.735 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 742 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.736 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.737 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.738 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 743 JS\x20Hel polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2024-01-23T08:18:17.739 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.740 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.741 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 3r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 4u a_inode 0,14 0 2081 [eventfd:3] 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 5u a_inode 0,14 0 2081 [eventfd:4] 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 6u unix 0xffffa0bb58223b80 0t0 16906 type=STREAM (CONNECTED) 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 7u a_inode 0,14 0 2081 [eventfd:5] 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 8r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 9u a_inode 0,14 0 2081 [eventfd:10] 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:polkitd 722 748 polkitd polkitd 10u unix 0xffffa0c1cc78d500 0t0 14153 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.742 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.743 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:smartd 723 root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 597694 1143 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.744 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.745 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 21219 1168 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 1u unix 0xffffa0bb584aa200 0t0 2494 type=STREAM (CONNECTED) 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 2u unix 0xffffa0bb584aa200 0t0 2494 type=STREAM (CONNECTED) 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 3u unix 0xffffa0bb5861a200 0t0 2519 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.746 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 4u a_inode 0,14 0 2081 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20] 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 5u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 6u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 7r REG 0,21 4096 22948 /sys/devices/virtual/tty/tty0/active 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 8u netlink 0t0 2530 KOBJECT_UEVENT 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 9r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 10r FIFO 0,24 0t0 1168 /run/systemd/inhibit/1.ref 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 11u netlink 0t0 2531 KOBJECT_UEVENT 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 12u netlink 0t0 2532 KOBJECT_UEVENT 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 13u netlink 0t0 2533 KOBJECT_UEVENT 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 14u unix 0xffffa0bb584af700 0t0 2534 type=STREAM (CONNECTED) 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 15u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 16u CHR 13,65 0t0 138 /dev/input/event1 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 17u CHR 13,64 0t0 137 /dev/input/event0 2024-01-23T08:18:17.747 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 18u CHR 13,66 0t0 148 /dev/input/event2 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 19u CHR 4,6 0t0 25 /dev/tty6 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:systemd-l 725 root 20r FIFO 0,24 0t0 1650 /run/systemd/sessions/4.ref 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.748 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.749 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root 1u unix 0xffffa0bb584aee80 0t0 2586 type=STREAM (CONNECTED) 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root 2u unix 0xffffa0bb584aee80 0t0 2586 type=STREAM (CONNECTED) 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root 3u IPv4 2596 0t0 TCP *:ssh (LISTEN) 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 778 root 4u IPv6 2598 0t0 TCP *:ssh (LISTEN) 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2024-01-23T08:18:17.750 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.751 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-01-23T08:18:17.752 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.753 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 1u unix 0xffffa0bb585afb40 0t0 21391 type=STREAM (CONNECTED) 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 2u unix 0xffffa0bb585afb40 0t0 21391 type=STREAM (CONNECTED) 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 4u sock 0,8 0t0 22156 protocol: NETLINK 2024-01-23T08:18:17.754 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 5u unix 0xffffa0bb5832b740 0t0 1465 type=STREAM (CONNECTED) 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 6u a_inode 0,14 0 2081 [eventfd:17] 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 7u unix 0xffffa0bb58391540 0t0 19998 type=STREAM (CONNECTED) 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 root 8u unix 0xffffa0bb58391dc0 0t0 19999 type=STREAM (CONNECTED) 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.755 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.756 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.757 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.758 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 1u unix 0xffffa0bb585afb40 0t0 21391 type=STREAM (CONNECTED) 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 2u unix 0xffffa0bb585afb40 0t0 21391 type=STREAM (CONNECTED) 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 3w REG 8,1 10371 1216 /var/log/tuned/tuned.log 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 4u sock 0,8 0t0 22156 protocol: NETLINK 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 5u unix 0xffffa0bb5832b740 0t0 1465 type=STREAM (CONNECTED) 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 6u a_inode 0,14 0 2081 [eventfd:17] 2024-01-23T08:18:17.759 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 7u unix 0xffffa0bb58391540 0t0 19998 type=STREAM (CONNECTED) 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:tuned 779 864 tuned root 8u unix 0xffffa0bb58391dc0 0t0 19999 type=STREAM (CONNECTED) 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.760 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-01-23T08:18:17.761 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.762 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 1u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 2u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 3u unix 0xffffa0bb581a6e80 0t0 16993 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 4r FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 5u a_inode 0,14 0 2081 [eventpoll:4,6,7,8] 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 6u a_inode 0,14 0 2081 [eventfd:16] 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 7u unix 0xffffa0bb58226600 0t0 16994 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 8u unix 0xffffa0bb58221100 0t0 16995 /run/gssproxy.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 root 9w FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.763 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-01-23T08:18:17.764 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-01-23T08:18:17.765 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 1u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 2u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 3u unix 0xffffa0bb581a6e80 0t0 16993 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 4r FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 5u a_inode 0,14 0 2081 [eventpoll:4,6,7,8] 2024-01-23T08:18:17.766 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 6u a_inode 0,14 0 2081 [eventfd:16] 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 7u unix 0xffffa0bb58226600 0t0 16994 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 8u unix 0xffffa0bb58221100 0t0 16995 /run/gssproxy.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 784 gssproxy root 9w FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.767 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.768 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.769 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 1u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 2u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 3u unix 0xffffa0bb581a6e80 0t0 16993 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 4r FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 5u a_inode 0,14 0 2081 [eventpoll:4,6,7,8] 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 6u a_inode 0,14 0 2081 [eventfd:16] 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 7u unix 0xffffa0bb58226600 0t0 16994 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 8u unix 0xffffa0bb58221100 0t0 16995 /run/gssproxy.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 785 gssproxy root 9w FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-01-23T08:18:17.770 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-01-23T08:18:17.771 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-01-23T08:18:17.772 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 1u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 2u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 3u unix 0xffffa0bb581a6e80 0t0 16993 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 4r FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 5u a_inode 0,14 0 2081 [eventpoll:4,6,7,8] 2024-01-23T08:18:17.773 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 6u a_inode 0,14 0 2081 [eventfd:16] 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 7u unix 0xffffa0bb58226600 0t0 16994 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 8u unix 0xffffa0bb58221100 0t0 16995 /run/gssproxy.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 786 gssproxy root 9w FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.774 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-01-23T08:18:17.775 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.776 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 1u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 2u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 3u unix 0xffffa0bb581a6e80 0t0 16993 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 4r FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 5u a_inode 0,14 0 2081 [eventpoll:4,6,7,8] 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 6u a_inode 0,14 0 2081 [eventfd:16] 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 7u unix 0xffffa0bb58226600 0t0 16994 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 8u unix 0xffffa0bb58221100 0t0 16995 /run/gssproxy.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 787 gssproxy root 9w FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.777 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.778 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.779 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 1u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 2u unix 0xffffa0bb58394c80 0t0 19993 type=STREAM (CONNECTED) 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 3u unix 0xffffa0bb581a6e80 0t0 16993 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 4r FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 5u a_inode 0,14 0 2081 [eventpoll:4,6,7,8] 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 6u a_inode 0,14 0 2081 [eventfd:16] 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 7u unix 0xffffa0bb58226600 0t0 16994 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.780 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 8u unix 0xffffa0bb58221100 0t0 16995 /run/gssproxy.sock type=STREAM (LISTEN) 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:gssproxy 783 788 gssproxy root 9w FIFO 0,13 0t0 16998 pipe 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root cwd DIR 8,1 4096 1657 /var/spool/at 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root txt REG 8,1 32680 12473 /usr/sbin/atd 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.781 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:atd 790 root 3uW REG 0,24 4 1189 /run/atd.pid 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root txt REG 8,1 74552 11234 /usr/sbin/crond 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.782 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root 1u unix 0xffffa0bb47f4e600 0t0 22142 type=STREAM (CONNECTED) 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root 2u unix 0xffffa0bb47f4e600 0t0 22142 type=STREAM (CONNECTED) 2024-01-23T08:18:17.783 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root 3uW REG 0,24 4 1190 /run/crond.pid 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root 4u unix 0xffffa0bb47f43b80 0t0 22145 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:crond 791 root 5r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe 1w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe 2w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.784 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe 3u IPv4 1489 0t0 TCP *:nrpe (LISTEN) 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe 4u unix 0xffffa0bb58333b80 0t0 1481 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:nrpe 885 nrpe 5u IPv6 1490 0t0 TCP *:nrpe (LISTEN) 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root 0u CHR 4,1 0t0 20 /dev/tty1 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root 1u CHR 4,1 0t0 20 /dev/tty1 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root 2u CHR 4,1 0t0 20 /dev/tty1 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1346 root 4r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.785 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root txt REG 8,1 58072 13690 /usr/sbin/agetty 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.786 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root 0u CHR 4,65 0t0 114 /dev/ttyS1 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root 1u CHR 4,65 0t0 114 /dev/ttyS1 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root 2u CHR 4,65 0t0 114 /dev/ttyS1 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:agetty 1356 root 4r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.787 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.788 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 1u unix 0xffffa0bb585ad0c0 0t0 23780 type=STREAM (CONNECTED) 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 2u unix 0xffffa0bb585ad0c0 0t0 23780 type=STREAM (CONNECTED) 2024-01-23T08:18:17.789 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 3u unix 0xffffa0bb5a625500 0t0 23808 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 4u a_inode 0,14 0 2081 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 5u a_inode 0,14 0 2081 [signalfd] 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 6r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 7r DIR 0,25 0 3392 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 8u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 9u a_inode 0,14 0 2081 [eventpoll:10,13] 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 10r REG 0,20 0 23797 /proc/3279/mountinfo 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 11r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 12u unix 0xffffa0bb585af2c0 0t0 23851 /run/user/1000/bus type=STREAM (LISTEN) 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 13r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 15u netlink 0t0 22875 KOBJECT_UEVENT 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 16u unix 0xffffa0c1cc78b300 0t0 22880 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 17u unix 0xffffa0c1cc78ee80 0t0 22881 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.790 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 18u unix 0xffffa0c1cc789100 0t0 22882 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 19u unix 0xffffa0bb58307700 0t0 22883 /run/user/1000/systemd/private type=STREAM (LISTEN) 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 20u unix 0xffffa0bb583072c0 0t0 22885 type=STREAM (CONNECTED) 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:systemd 3279 ubuntu 21u a_inode 0,14 0 2081 [timerfd] 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu DEL REG 8,1 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-01-23T08:18:17.791 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2024-01-23T08:18:17.792 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2024-01-23T08:18:17.793 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu DEL REG 8,1 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu 1u unix 0xffffa0bb585ad0c0 0t0 23780 type=STREAM (CONNECTED) 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu 2u unix 0xffffa0bb585ad0c0 0t0 23780 type=STREAM (CONNECTED) 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu 3u a_inode 0,14 0 2081 [eventfd:13] 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu 4u a_inode 0,14 0 2081 [eventfd:14] 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu 6w FIFO 0,13 0t0 23784 pipe 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:(sd-pam) 3291 ubuntu 7u unix 0xffffa0bb5a624400 0t0 23800 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.794 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.795 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 1w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 2w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 3r CHR 1,9 0t0 9 /dev/urandom 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 4u unix 0xffffa0bb5861c840 0t0 3049 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 5w REG 8,1 627286 1642 /var/log/secure 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 6r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 7r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.796 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 8w REG 8,1 1593605 1641 /var/log/messages 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 root 10w REG 8,1 2543 1220 /var/log/cron 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.797 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 4u unix 0xffffa0bb5861c840 0t0 3049 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 5w REG 8,1 627286 1642 /var/log/secure 2024-01-23T08:18:17.798 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 6r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 7r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 8w REG 8,1 1593605 1641 /var/log/messages 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5038 in:imjour root 10w REG 8,1 2543 1220 /var/log/cron 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.799 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.800 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 4u unix 0xffffa0bb5861c840 0t0 3049 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 5w REG 8,1 627286 1642 /var/log/secure 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 6r a_inode 0,14 0 2081 inotify 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 7r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 8w REG 8,1 1593605 1641 /var/log/messages 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:rsyslogd 5035 5039 rs:main root 10w REG 8,1 2543 1220 /var/log/cron 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:tls-strp 16084 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:tls-strp 16084 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:tls-strp 16084 root txt unknown /proc/16084/exe 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20462 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20462 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20462 root txt unknown /proc/20462/exe 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20491 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20491 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.801 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20491 root txt unknown /proc/20491/exe 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20520 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20520 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20520 root txt unknown /proc/20520/exe 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20549 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20549 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20549 root txt unknown /proc/20549/exe 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20578 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20578 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:kdmflush/ 20578 root txt unknown /proc/20578/exe 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:xfsalloc 20742 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:xfsalloc 20742 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:xfsalloc 20742 root txt unknown /proc/20742/exe 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:xfs_mru_c 20743 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:xfs_mru_c 20743 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.802 INFO:teuthology.orchestra.run.smithi173.stdout:xfs_mru_c 20743 root txt unknown /proc/20743/exe 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-buf/d 20744 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-buf/d 20744 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-buf/d 20744 root txt unknown /proc/20744/exe 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-conv/ 20745 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-conv/ 20745 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-conv/ 20745 root txt unknown /proc/20745/exe 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-recla 20746 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-recla 20746 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-recla 20746 root txt unknown /proc/20746/exe 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-block 20747 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-block 20747 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-block 20747 root txt unknown /proc/20747/exe 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-inode 20748 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-inode 20748 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.803 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-inode 20748 root txt unknown /proc/20748/exe 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-log/d 20749 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-log/d 20749 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-log/d 20749 root txt unknown /proc/20749/exe 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-cil/d 20750 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-cil/d 20750 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-cil/d 20750 root txt unknown /proc/20750/exe 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfsaild/d 20751 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfsaild/d 20751 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:xfsaild/d 20751 root txt unknown /proc/20751/exe 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-01-23T08:18:17.804 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-01-23T08:18:17.805 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.806 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.807 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 3u unix 0xffffa0bb5a624c80 0t0 89802 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 4u IPv4 93610 0t0 TCP smithi173.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:56984 (ESTABLISHED) 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 6u unix 0xffffa0bb585a8cc0 0t0 89777 type=STREAM (CONNECTED) 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 7w FIFO 0,24 0t0 1650 /run/systemd/sessions/4.ref 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22697 root 8u unix 0xffffa0bb585a8440 0t0 89806 type=STREAM (CONNECTED) 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.808 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2024-01-23T08:18:17.809 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-01-23T08:18:17.810 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.811 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 3u unix 0xffffa0bb5a624c80 0t0 89802 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 4u IPv4 93610 0t0 TCP smithi173.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:56984 (ESTABLISHED) 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 5u unix 0xffffa0bb585a8880 0t0 89805 type=STREAM (CONNECTED) 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 6u unix 0xffffa0bb585a8cc0 0t0 89777 type=STREAM (CONNECTED) 2024-01-23T08:18:17.812 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 7w FIFO 0,24 0t0 1650 /run/systemd/sessions/4.ref 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 12r FIFO 0,13 0t0 132725 pipe 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 14r FIFO 0,13 0t0 132726 pipe 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 25w FIFO 0,13 0t0 118820 pipe 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 27r FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:sshd 22700 ubuntu 29r FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2024-01-23T08:18:17.813 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony 1w CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony 2u CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony 3u unix 0xffffa0bb58335500 0t0 94751 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony 5u IPv4 94756 0t0 UDP localhost:323 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony 6u IPv6 94757 0t0 UDP localhost:323 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:chronyd 22760 chrony 7u unix 0xffffa0bb58333300 0t0 94758 /run/chrony/chronyd.sock type=DGRAM (UNCONNECTED) 2024-01-23T08:18:17.814 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.815 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph 1u unix 0xffffa0bb585abb80 0t0 89991 type=STREAM (CONNECTED) 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-cras 22985 ceph 2u unix 0xffffa0bb585abb80 0t0 89991 type=STREAM (CONNECTED) 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 23503 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 23503 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 23503 root txt unknown /proc/23503/exe 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 24712 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.816 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 24712 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/7 24712 root txt unknown /proc/24712/exe 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 24805 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 24805 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 24805 root txt unknown /proc/24805/exe 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 25266 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 25266 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 25266 root txt unknown /proc/25266/exe 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 25592 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 25592 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 25592 root txt unknown /proc/25592/exe 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 27723 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 27723 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 27723 root txt unknown /proc/27723/exe 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 27884 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.817 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 27884 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 27884 root txt unknown /proc/27884/exe 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 28033 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 28033 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 28033 root txt unknown /proc/28033/exe 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-buf/d 29078 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-buf/d 29078 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-buf/d 29078 root txt unknown /proc/29078/exe 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-conv/ 29079 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-conv/ 29079 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-conv/ 29079 root txt unknown /proc/29079/exe 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-recla 29080 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-recla 29080 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-recla 29080 root txt unknown /proc/29080/exe 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-block 29081 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.818 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-block 29081 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-block 29081 root txt unknown /proc/29081/exe 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-inode 29082 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-inode 29082 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-inode 29082 root txt unknown /proc/29082/exe 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-log/d 29083 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-log/d 29083 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-log/d 29083 root txt unknown /proc/29083/exe 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-cil/d 29084 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-cil/d 29084 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfs-cil/d 29084 root txt unknown /proc/29084/exe 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfsaild/d 29085 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfsaild/d 29085 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:xfsaild/d 29085 root txt unknown /proc/29085/exe 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 32605 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.819 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 32605 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 32605 root txt unknown /proc/32605/exe 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:dio/dm-3 32653 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:dio/dm-3 32653 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:dio/dm-3 32653 root txt unknown /proc/32653/exe 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root txt REG 8,1 185296 11759 /usr/bin/sudo 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-01-23T08:18:17.820 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.821 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.822 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:17.823 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root 0r FIFO 0,13 0t0 118820 pipe 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root 3r FIFO 0,13 0t0 118834 pipe 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root 4w FIFO 0,13 0t0 118834 pipe 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root 5u netlink 0t0 115358 AUDIT 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 34783 root 6u unix 0xffffa0bb4307d500 0t0 115359 type=DGRAM (CONNECTED) 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.824 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.825 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root 0r FIFO 0,13 0t0 118820 pipe 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:daemon-he 34836 root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.826 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.827 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.828 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.829 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.830 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.831 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.832 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.833 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.833 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.863 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.864 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.865 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.866 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.867 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.868 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.869 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.870 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.871 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.872 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.873 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.874 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.875 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.876 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.877 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.878 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34857 log root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.879 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.880 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.881 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.882 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.883 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.884 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.885 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.886 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.887 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.888 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.889 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34876 msgr-work root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.890 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.891 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.892 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.893 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.894 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.895 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.896 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.897 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.898 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.899 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.900 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34878 msgr-work root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.901 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.903 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.903 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.903 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.903 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.903 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.903 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.903 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.904 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.905 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.906 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.907 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.908 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.909 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.910 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.911 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.912 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34879 msgr-work root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.913 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.914 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.915 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.916 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.917 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.918 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.919 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.920 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.921 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.922 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.923 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34893 service root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.924 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.925 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.926 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.927 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.928 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.929 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.930 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.931 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.932 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.933 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.934 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34894 admin_soc root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.935 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.936 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.937 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.938 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.939 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.940 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.941 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.942 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.943 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.944 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.945 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.946 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34916 signal_ha root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.947 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.948 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.949 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.950 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.951 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.952 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.953 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.954 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.955 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.956 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.957 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34917 io_contex root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.958 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.959 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.960 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.961 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.962 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.963 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.964 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.965 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.966 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.967 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.968 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34918 io_contex root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.969 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.970 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.971 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.972 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.973 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.974 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.975 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.976 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.977 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.978 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.979 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34939 OpHistory root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.980 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.981 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.982 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.983 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.984 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.985 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.986 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.987 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.988 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.989 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:17.990 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 34940 ceph_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:17.991 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:17.992 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:17.993 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:17.994 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:17.995 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:17.996 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:17.997 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.998 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:17.999 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.000 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.001 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.002 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35029 memcheck- root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.003 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.004 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.005 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.006 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.007 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.008 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.009 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.010 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.011 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.012 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.013 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35030 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.014 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.015 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.016 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.017 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.018 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.019 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.020 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.021 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.022 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.023 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.024 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35033 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.025 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.026 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.027 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.028 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.029 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.030 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.031 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.032 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.033 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.034 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.035 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35035 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.036 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.037 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.038 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.039 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.040 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.041 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.042 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.043 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.044 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.045 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.046 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35037 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.047 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.048 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.049 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.050 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.051 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.052 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.053 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.054 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.055 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.056 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.057 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35038 fn_anonym root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.058 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.059 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.060 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.061 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.062 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.063 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.064 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.065 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.066 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.067 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.068 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35057 rocksdb:l root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.069 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.070 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.071 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.072 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.073 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.074 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.075 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.076 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.077 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.078 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.079 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35060 rocksdb:l root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.080 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.081 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.082 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.083 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.084 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.085 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.086 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.087 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.088 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.089 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.090 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35062 rocksdb:l root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.091 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.092 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.093 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.094 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.095 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.096 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.097 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.098 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.099 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.100 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.101 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 35064 rocksdb:h root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.102 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.103 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.104 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.107 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.108 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.109 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.110 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.111 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.112 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.113 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.114 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36598 bstore_ai root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.115 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.116 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.117 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.118 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.119 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.120 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.121 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.122 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.123 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.124 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.125 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 36599 bstore_di root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.126 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.127 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.128 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.129 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.130 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.132 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.133 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.134 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.135 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.136 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37315 bstore_ai root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.137 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.138 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.139 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.140 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.141 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.142 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.143 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.144 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.145 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.146 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.147 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37316 bstore_di root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.148 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.149 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.150 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.151 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.152 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.153 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.154 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.155 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.156 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.157 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.158 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37990 memcheck- root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.159 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.160 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.161 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.162 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.163 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.164 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.165 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.166 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.167 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.168 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.169 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37994 cfin root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.170 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.171 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.172 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.173 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.174 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.175 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.176 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.177 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.178 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.179 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.180 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37995 bstore_kv root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.181 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.182 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.183 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.184 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.185 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.186 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.187 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.188 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.189 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.190 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.191 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37996 bstore_kv root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.192 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.193 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.194 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.195 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.196 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.197 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.198 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.199 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.200 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.201 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 37998 bstore_me root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.202 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.203 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.204 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.205 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.206 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.207 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.208 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.209 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.210 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.211 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.212 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.213 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38064 ms_dispat root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.214 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.215 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.216 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.217 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.218 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.219 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.220 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.221 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.222 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.223 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38070 ms_local root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.224 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.225 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.226 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.227 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.228 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.229 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.230 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.231 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.232 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.233 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.234 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38074 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.235 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.236 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.237 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.238 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.239 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.240 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.241 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.242 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.243 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.244 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.245 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38077 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.246 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.247 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.248 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.249 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.250 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.251 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.252 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.253 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.254 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.255 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.256 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38081 ms_dispat root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.257 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.258 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.259 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.260 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.261 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.262 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.263 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.264 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.265 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.266 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.267 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38084 ms_local root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.268 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.269 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.270 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.271 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.272 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.273 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.274 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.275 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.276 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.277 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.278 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38086 ms_dispat root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.279 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.280 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.281 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.282 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.283 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.284 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.285 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.286 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.287 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.288 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38090 ms_local root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.289 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.290 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.291 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.292 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.293 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.294 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.295 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.296 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.297 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.298 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.299 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38094 ms_dispat root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.300 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.301 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.302 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.303 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.304 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.305 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.306 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.307 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.308 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.309 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.310 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.311 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38097 ms_local root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.312 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.313 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.314 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.315 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.316 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.317 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.318 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.319 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.320 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.321 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.322 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38100 ms_dispat root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.323 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.324 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.325 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.326 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.327 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.328 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.329 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.330 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.331 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.332 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.333 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38103 ms_local root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.334 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.335 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.336 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.337 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.338 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.339 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.340 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.341 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.342 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.343 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.344 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38106 ms_dispat root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.345 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.346 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.347 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.348 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.349 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.350 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.351 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.352 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.353 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.354 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.355 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38109 ms_local root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.356 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.357 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.358 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.359 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.360 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.361 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.362 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.363 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.364 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.365 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.366 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38112 ms_dispat root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.367 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.368 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.369 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.370 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.371 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.372 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.373 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.374 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.375 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.376 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.377 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38113 ms_local root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.378 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.379 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.380 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.381 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.382 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.383 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.384 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.385 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.386 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.387 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.388 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38115 fn_anonym root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.389 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.390 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.391 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.392 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.393 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.394 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.395 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.396 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.397 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.398 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38117 finisher root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.399 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.400 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.401 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.402 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.403 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.404 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.405 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.406 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.407 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.408 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.409 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38119 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.410 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.411 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.412 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.413 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.414 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.415 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.416 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.417 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.418 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.419 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.420 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38121 safe_time root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.421 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.422 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.423 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.424 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.425 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.426 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.427 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.428 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.429 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.430 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.431 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38123 memcheck- root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.432 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.433 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.434 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.435 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.436 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.437 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.438 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.439 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.440 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.441 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.442 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38125 osd_srv_a root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.443 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.444 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.445 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.446 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.447 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.448 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.449 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.450 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.451 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.452 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38127 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.453 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.454 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.455 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.456 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.457 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.458 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.459 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.460 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.461 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.462 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.463 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38129 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.464 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.465 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.466 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.467 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.468 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.469 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.470 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.471 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.472 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.473 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.474 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38131 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.475 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.476 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.477 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.478 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.479 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.480 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.481 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.482 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.483 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.484 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.485 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38133 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.486 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.487 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.488 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.489 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.490 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.491 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.492 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.493 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.494 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.495 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.496 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38135 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.497 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.498 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.499 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.500 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.501 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.502 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.503 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.504 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.505 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.506 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.507 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38137 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.508 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.509 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.510 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.511 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.513 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.515 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.516 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.517 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.518 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38139 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.519 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.520 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.521 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.522 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.523 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.524 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.525 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.526 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.527 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.528 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38141 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.529 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.530 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.531 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.532 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.533 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.534 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.535 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.536 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.537 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.538 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.539 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38143 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.540 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.541 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.542 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.543 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.544 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.545 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.546 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.547 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.548 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.549 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.550 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38145 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.551 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.552 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.553 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.554 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.555 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.556 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.557 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.558 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.559 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.560 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.561 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38147 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.562 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.563 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.564 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.565 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.566 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.567 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.568 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.569 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.570 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.571 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.572 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38149 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.573 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.574 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.575 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.576 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.577 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.578 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.579 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.580 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.581 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.582 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38150 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.583 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.584 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.585 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.586 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.587 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.588 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.589 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.590 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.591 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.592 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.593 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.594 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38151 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.595 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.596 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.597 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.598 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.599 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.600 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.601 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.602 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.603 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.604 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.605 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38152 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.606 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.607 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.608 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.609 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.610 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.611 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.612 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.613 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.614 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.615 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.616 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38153 tp_osd_tp root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root cwd DIR 8,1 4096 265930 /home/ubuntu/cephtest 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root txt REG 8,1 2658080 27585 /usr/libexec/valgrind/memcheck-amd64-linux 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 22256 27655 /usr/libexec/valgrind/vgpreload_core-amd64-linux.so 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 342328 27660 /usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 15752 265649 /usr/lib64/rados-classes/libcls_sdk.so.1.0.0 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 326760 2336 /usr/lib64/libtcmalloc.so.4.5.9 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 270800 9964 /usr/lib64/libfuse.so.2.9.9 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 16448 9879 /usr/lib64/libaio.so.1.0.1 2024-01-23T08:18:18.617 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 49744 10813 /usr/lib64/libsnappy.so.1.1.8 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 639224 2285 /usr/lib64/libthrift-0.15.0.so 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 137720 10598 /usr/lib64/libibverbs.so.1.14.46.0 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 112536 10937 /usr/lib64/librdmacm.so.1.3.46.0 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.618 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 61880 2326 /usr/lib64/libunwind.so.8.0.1 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 600544 9820 /usr/lib64/libnl-route-3.so.200.26.0 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 146872 9812 /usr/lib64/libnl-3.so.200.26.0 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2024-01-23T08:18:18.619 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 24328 265652 /usr/lib64/rados-classes/libcls_test_remote_reads.so.1.0.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 53272 2262 /usr/lib64/liblttng-ust-tracepoint.so.0.0.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 51400 1770 /usr/lib64/libnuma.so.1.0.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 41360 11862 /usr/lib64/liburcu-bp.so.6.1.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 45480 11864 /usr/lib64/liburcu-cds.so.6.1.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 24248 11866 /usr/lib64/liburcu-common.so.6.1.0 2024-01-23T08:18:18.620 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 74680 265594 /usr/lib64/ceph/extblkdev/libceph_ebd_vdo.so 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 353376 265584 /usr/lib64/ceph/erasure-code/libec_jerasure.so 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 1469200 265588 /usr/lib64/ceph/erasure-code/libec_lrc.so 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 32664 265569 /usr/lib64/ceph/compressor/libceph_snappy.so.2.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 32512 265628 /usr/lib64/rados-classes/libcls_numops.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 37064 265613 /usr/lib64/rados-classes/libcls_hello.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 409328 265637 /usr/lib64/rados-classes/libcls_rbd.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 70432 265631 /usr/lib64/rados-classes/libcls_otp.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 69736 2300 /usr/lib64/liboath.so.0.1.3 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 70536 265607 /usr/lib64/rados-classes/libcls_cmpomap.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 36976 265661 /usr/lib64/rados-classes/libcls_version.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 41168 265604 /usr/lib64/rados-classes/libcls_cephfs.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 74928 265601 /usr/lib64/rados-classes/libcls_cas.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 65968 265658 /usr/lib64/rados-classes/libcls_user.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 45176 265655 /usr/lib64/rados-classes/libcls_timeindex.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 864240 265640 /usr/lib64/rados-classes/libcls_refcount.so.1.0.0 2024-01-23T08:18:18.621 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 208168 265610 /usr/lib64/rados-classes/libcls_fifo.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 1334544 265643 /usr/lib64/rados-classes/libcls_rgw.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 49416 265622 /usr/lib64/rados-classes/libcls_log.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 83008 265616 /usr/lib64/rados-classes/libcls_journal.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 91232 265634 /usr/lib64/rados-classes/libcls_queue.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 128904 265598 /usr/lib64/rados-classes/libcls_2pc_queue.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 821984 265625 /usr/lib64/rados-classes/libcls_lua.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 287296 9996 /usr/lib64/liblua-5.4.so 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 116432 265646 /usr/lib64/rados-classes/libcls_rgw_gc.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 74504 265619 /usr/lib64/rados-classes/libcls_lock.so.1.0.0 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root mem REG 8,1 48 3996 /tmp/vgdb-pipe-shared-mem-vgdb-34843-by-root-on-??? 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root DEL REG 0,17 115414 /[aio] 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root DEL REG 0,17 119930 /[aio] 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 1w FIFO 0,13 0t0 118821 pipe 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 2w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.622 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 3w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 4r FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 5w FIFO 0,13 0t0 116000 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 6u a_inode 0,14 0 2081 [eventpoll:7,20,21,22,23,24,25,26,27] 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 7r FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 8w FIFO 0,13 0t0 118863 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 9u a_inode 0,14 0 2081 [eventpoll:10,65,66] 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 10r FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 11w FIFO 0,13 0t0 118864 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 12u a_inode 0,14 0 2081 [eventpoll:13] 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 13r FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 14w FIFO 0,13 0t0 118865 pipe 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 15w REG 8,1 706938154 265360 /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 16uW REG 0,24 6 2020 /run/ceph/ceph-osd.7.pid 2024-01-23T08:18:18.623 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 17r FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 18w FIFO 0,13 0t0 111495 pipe 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 19u unix 0xffffa0bb58395d80 0t0 111496 /var/run/ceph/ceph-osd.7.asok type=STREAM (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 20u IPv4 120904 0t0 TCP *:6824 (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 21u IPv4 120930 0t0 TCP *:6825 (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 22u IPv4 128917 0t0 TCP smithi173.front.sepia.ceph.com:6832 (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 23u IPv4 128949 0t0 TCP smithi173.front.sepia.ceph.com:6833 (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 24u IPv4 121014 0t0 TCP *:6828 (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 25u IPv4 121044 0t0 TCP *:6829 (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 26u IPv4 121075 0t0 TCP *:6830 (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 27u IPv4 121107 0t0 TCP *:ambit-lm (LISTEN) 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 28r FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 29w FIFO 0,13 0t0 115390 pipe 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 30r FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.624 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 31w FIFO 0,13 0t0 115391 pipe 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 32u sock 0,8 0t0 118882 protocol: UDPv6 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 33r DIR 253,3 357 64 /var/lib/ceph/osd/ceph-7 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 34uW REG 253,3 37 69 /var/lib/ceph/osd/ceph-7/fsid 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 35u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 36u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 37u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 38u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 39u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 40u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 41u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 42u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 43u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 44u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 45u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.625 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 46u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 47u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 48u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 49u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 50u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 51u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 52u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 53u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 54u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 55u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 56u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 57u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 58u REG 253,3 96636764160 70 /var/lib/ceph/osd/ceph-7/block 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 59r FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.626 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 61w FIFO 0,13 0t0 117144 pipe 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 62r FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 63w FIFO 0,13 0t0 117145 pipe 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 65u IPv4 135413 0t0 TCP smithi173.front.sepia.ceph.com:51508->smithi173.front.sepia.ceph.com:6824 (ESTABLISHED) 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root 66u IPv4 136438 0t0 TCP smithi173.front.sepia.ceph.com:6824->smithi173.front.sepia.ceph.com:51508 (ESTABLISHED) 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *524r REG 8,1 24897376 2837 /usr/bin/ceph-osd 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *525u REG 8,1 32 3397 /tmp/valgrind_proc_34843_cmdline_a58336bd (deleted) 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *526u REG 8,1 336 3436 /tmp/valgrind_proc_34843_auxv_a58336bd (deleted) 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *527w FIFO 0,13 0t0 118822 pipe 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *528w REG 8,1 1234 917795 /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *529r FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *530w FIFO 0,13 0t0 115999 pipe 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:memcheck- 34843 38154 osd_srv_h root *531r FIFO 8,1 0t0 4051 /tmp/vgdb-pipe-from-vgdb-to-34843-by-root-on-??? 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 38155 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 38155 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.627 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/5 38155 root txt unknown /proc/38155/exe 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 38161 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 38161 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/4 38161 root txt unknown /proc/38161/exe 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 38184 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 38184 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 38184 root txt unknown /proc/38184/exe 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 38188 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 38188 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/6 38188 root txt unknown /proc/38188/exe 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 38217 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 38217 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 38217 root txt unknown /proc/38217/exe 2024-01-23T08:18:18.628 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 38219 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 38219 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 38219 root txt unknown /proc/38219/exe 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38222 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38222 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38222 root txt unknown /proc/38222/exe 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 38237 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 38237 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/1 38237 root txt unknown /proc/38237/exe 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38238 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38238 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38238 root txt unknown /proc/38238/exe 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 38240 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 38240 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/2 38240 root txt unknown /proc/38240/exe 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 38241 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.629 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 38241 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/0 38241 root txt unknown /proc/38241/exe 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 38242 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 38242 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/3 38242 root txt unknown /proc/38242/exe 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38260 root cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38260 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:kworker/u 38260 root txt unknown /proc/38260/exe 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot cwd DIR 8,1 4096 2 / 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot txt REG 8,1 15448 10498 /usr/bin/python3.9 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 761440 9750 /usr/lib64/libsepol.so.2 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 1522832 39903 /usr/lib64/python3.9/site-packages/setools/policyrep.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 254800 39730 /usr/lib64/python3.9/site-packages/selinux/audit2why.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.630 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 356860 37016 /usr/lib64/girepository-1.0/Gio-2.0.typelib 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 78840 41984 /usr/lib64/python3.9/lib-dynload/_elementtree.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.631 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 276056 39728 /usr/lib64/python3.9/site-packages/selinux/_selinux.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 41384 38243 /usr/lib64/python3.9/lib-dynload/binascii.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.632 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 59588 37015 /usr/lib64/girepository-1.0/GObject-2.0.typelib 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.633 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 15808 38252 /usr/lib64/python3.9/lib-dynload/syslog.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot 0r CHR 1,3 0t0 4 /dev/null 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot 1u unix 0xffffa0bb584a8000 0t0 136522 type=STREAM (CONNECTED) 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot 2u unix 0xffffa0bb584a8000 0t0 136522 type=STREAM (CONNECTED) 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:setrouble 38320 setroubleshoot 3r REG 8,1 3614542 2525 /etc/selinux/targeted/policy/policy.33 2024-01-23T08:18:18.634 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:18.635 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu 0r FIFO 0,13 0t0 132724 pipe 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu 1w FIFO 0,13 0t0 132725 pipe 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:bash 38321 ubuntu 2w FIFO 0,13 0t0 132726 pipe 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root txt REG 8,1 185296 11759 /usr/bin/sudo 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2024-01-23T08:18:18.636 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.637 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2024-01-23T08:18:18.638 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.639 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root 0r FIFO 0,13 0t0 132724 pipe 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root 1w FIFO 0,13 0t0 132725 pipe 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root 2w FIFO 0,13 0t0 132726 pipe 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root 3r FIFO 0,13 0t0 133583 pipe 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root 4w FIFO 0,13 0t0 133583 pipe 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root 5u netlink 0t0 133589 AUDIT 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:sudo 38337 root 6u unix 0xffffa0bb4307c400 0t0 133590 type=DGRAM (CONNECTED) 2024-01-23T08:18:18.640 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root txt REG 8,1 179232 12343 /usr/bin/lsof 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.641 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root 0r FIFO 0,13 0t0 132724 pipe 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root 1w FIFO 0,13 0t0 132725 pipe 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root 2w FIFO 0,13 0t0 132726 pipe 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root 3r DIR 0,20 0 1 /proc 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root 4r DIR 0,20 0 137723 /proc/38339/fd 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root 5w FIFO 0,13 0t0 137728 pipe 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38339 root 6r FIFO 0,13 0t0 137729 pipe 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root cwd DIR 8,1 4096 1026 /home/ubuntu 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root rtd DIR 8,1 4096 2 / 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root txt REG 8,1 179232 12343 /usr/bin/lsof 2024-01-23T08:18:18.642 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2024-01-23T08:18:18.643 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root 4r FIFO 0,13 0t0 137728 pipe 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:lsof 38340 root 7w FIFO 0,13 0t0 137729 pipe 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 2 0.0 0.0 0 0 ? S 06:58 0:00 [kthreadd] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 3 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [rcu_gp] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 4 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [rcu_par_gp] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 5 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [slub_flushwq] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 6 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [netns] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 8 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/0:0H-events_highpri] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 10 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [mm_percpu_wq] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 12 0.0 0.0 0 0 ? I 06:58 0:00 \_ [rcu_tasks_kthre] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 13 0.0 0.0 0 0 ? I 06:58 0:00 \_ [rcu_tasks_rude_] 2024-01-23T08:18:18.644 INFO:teuthology.orchestra.run.smithi173.stdout:root 14 0.0 0.0 0 0 ? I 06:58 0:00 \_ [rcu_tasks_trace] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 15 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/0] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 16 0.1 0.0 0 0 ? S 06:58 0:04 \_ [pr/ttyS1] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 17 0.0 0.0 0 0 ? I 06:58 0:01 \_ [rcu_preempt] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 18 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/0] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 19 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/0] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 21 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/0] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 22 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/1] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 23 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/1] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 24 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/1] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 25 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/1] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 27 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/1:0H-events_highpri] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 28 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/2] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 29 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/2] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 30 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/2] 2024-01-23T08:18:18.645 INFO:teuthology.orchestra.run.smithi173.stdout:root 31 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/2] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 33 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/2:0H-events_highpri] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 34 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/3] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 35 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/3] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 36 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/3] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 37 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/3] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 39 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/3:0H-events_highpri] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 40 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/4] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 41 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/4] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 42 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/4] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 43 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/4] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 45 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/4:0H-events_highpri] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 46 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/5] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 47 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/5] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 48 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/5] 2024-01-23T08:18:18.646 INFO:teuthology.orchestra.run.smithi173.stdout:root 49 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/5] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 51 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/5:0H-events_highpri] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 52 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/6] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 53 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/6] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 54 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/6] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 55 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/6] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 57 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/6:0H-events_highpri] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 58 0.0 0.0 0 0 ? S 06:58 0:00 \_ [cpuhp/7] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 59 0.0 0.0 0 0 ? S 06:58 0:00 \_ [idle_inject/7] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 60 0.0 0.0 0 0 ? S 06:58 0:00 \_ [migration/7] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 61 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ksoftirqd/7] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 62 0.0 0.0 0 0 ? I 06:58 0:01 \_ [kworker/7:0-rcu_gp] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 63 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/7:0H-events_highpri] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 71 0.0 0.0 0 0 ? S 06:58 0:00 \_ [kdevtmpfs] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 72 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [inet_frag_wq] 2024-01-23T08:18:18.647 INFO:teuthology.orchestra.run.smithi173.stdout:root 73 0.0 0.0 0 0 ? S 06:58 0:00 \_ [kauditd] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 75 0.0 0.0 0 0 ? S 06:58 0:00 \_ [khungtaskd] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 76 0.0 0.0 0 0 ? S 06:58 0:00 \_ [oom_reaper] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 77 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [writeback] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 78 0.0 0.0 0 0 ? S 06:58 0:00 \_ [kcompactd0] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 79 0.0 0.0 0 0 ? SN 06:58 0:00 \_ [ksmd] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 81 0.0 0.0 0 0 ? SN 06:58 0:00 \_ [khugepaged] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 82 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [cryptd] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 83 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kintegrityd] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 84 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kblockd] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 85 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [blkcg_punt_bio] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 86 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [tpm_dev_wq] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 87 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [md] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 88 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [md_bitmap] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 89 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [edac-poller] 2024-01-23T08:18:18.648 INFO:teuthology.orchestra.run.smithi173.stdout:root 90 0.0 0.0 0 0 ? S 06:58 0:00 \_ [watchdogd] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 92 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/5:1H-xfs-log/dm-1] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 95 0.0 0.0 0 0 ? S 06:58 0:00 \_ [kswapd0] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 101 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kthrotld] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 109 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [acpi_thermal_pm] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 110 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kmpath_rdacd] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 111 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kaluad] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 113 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [mld] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 114 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/1:1H-kblockd] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 115 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [ipv6_addrconf] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 124 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kstrp] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 130 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [zswap-shrink] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 131 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/u17:0] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 277 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/4:1H-kblockd] 2024-01-23T08:18:18.649 INFO:teuthology.orchestra.run.smithi173.stdout:root 279 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/3:1H-xfs-log/dm-2] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 282 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/7:1H-kblockd] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 284 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/6:1H-kblockd] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 287 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/0:1H-kblockd] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 329 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [kworker/2:1H-kblockd] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 437 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [nvme-wq] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 438 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [nvme-reset-wq] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 439 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [nvme-delete-wq] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 440 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [nvme-auth-wq] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 442 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [ata_sff] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 443 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [ixgbe] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 449 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_0] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 450 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_0] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 451 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_1] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 452 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_1] 2024-01-23T08:18:18.650 INFO:teuthology.orchestra.run.smithi173.stdout:root 453 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_2] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 454 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_2] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 455 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_3] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 456 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_3] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 458 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_4] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 459 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_4] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 460 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_5] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 461 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_5] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 462 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_6] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 463 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_6] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 464 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_7] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 465 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_7] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 466 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_8] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 467 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_8] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 468 0.0 0.0 0 0 ? S 06:58 0:00 \_ [scsi_eh_9] 2024-01-23T08:18:18.651 INFO:teuthology.orchestra.run.smithi173.stdout:root 469 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [scsi_tmf_9] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 498 0.0 0.0 0 0 ? S 06:58 0:00 \_ [jbd2/sda1-8] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 499 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [ext4-rsv-conver] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 581 0.0 0.0 0 0 ? S 06:58 0:00 \_ [ext4lazyinit] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 638 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [ipmi-msghandler] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 657 0.0 0.0 0 0 ? SN 06:58 0:00 \_ [kipmi0] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 673 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [rpciod] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 674 0.0 0.0 0 0 ? I< 06:58 0:00 \_ [xprtiod] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 16084 0.0 0.0 0 0 ? I< 07:01 0:00 \_ [tls-strp] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 20462 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [kdmflush/253:0] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 20491 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [kdmflush/253:1] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 20520 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [kdmflush/253:2] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 20549 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [kdmflush/253:3] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 20578 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [kdmflush/253:4] 2024-01-23T08:18:18.652 INFO:teuthology.orchestra.run.smithi173.stdout:root 20742 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfsalloc] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20743 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs_mru_cache] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20744 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs-buf/dm-4] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20745 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs-conv/dm-4] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20746 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs-reclaim/dm-] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20747 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs-blockgc/dm-] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20748 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs-inodegc/dm-] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20749 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs-log/dm-4] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20750 0.0 0.0 0 0 ? I< 07:11 0:00 \_ [xfs-cil/dm-4] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 20751 0.0 0.0 0 0 ? S 07:11 0:00 \_ [xfsaild/dm-4] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 23503 0.0 0.0 0 0 ? I 07:17 0:01 \_ [kworker/u16:6-writeback] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 24712 0.1 0.0 0 0 ? I 07:17 0:04 \_ [kworker/7:3-events] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 24805 0.0 0.0 0 0 ? I 07:17 0:00 \_ [kworker/u16:7-flush-8:0] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 25266 0.0 0.0 0 0 ? I 07:17 0:00 \_ [kworker/6:255-dio/dm-0] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 25592 0.0 0.0 0 0 ? I 07:17 0:00 \_ [kworker/4:254-dio/dm-0] 2024-01-23T08:18:18.653 INFO:teuthology.orchestra.run.smithi173.stdout:root 27723 0.0 0.0 0 0 ? I 07:19 0:00 \_ [kworker/5:2-mm_percpu_wq] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 27884 0.0 0.0 0 0 ? I 07:27 0:00 \_ [kworker/u16:0-flush-8:0] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 28033 0.0 0.0 0 0 ? I 07:30 0:00 \_ [kworker/2:1-events] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29078 0.0 0.0 0 0 ? I< 07:31 0:00 \_ [xfs-buf/dm-3] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29079 0.0 0.0 0 0 ? I< 07:31 0:00 \_ [xfs-conv/dm-3] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29080 0.0 0.0 0 0 ? I< 07:31 0:00 \_ [xfs-reclaim/dm-] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29081 0.0 0.0 0 0 ? I< 07:31 0:00 \_ [xfs-blockgc/dm-] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29082 0.0 0.0 0 0 ? I< 07:31 0:00 \_ [xfs-inodegc/dm-] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29083 0.0 0.0 0 0 ? I< 07:31 0:00 \_ [xfs-log/dm-3] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29084 0.0 0.0 0 0 ? I< 07:31 0:00 \_ [xfs-cil/dm-3] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 29085 0.0 0.0 0 0 ? S 07:31 0:00 \_ [xfsaild/dm-3] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 32605 0.0 0.0 0 0 ? I 07:32 0:00 \_ [kworker/3:1-mm_percpu_wq] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 32653 0.0 0.0 0 0 ? I< 07:32 0:00 \_ [dio/dm-3] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 38155 0.0 0.0 0 0 ? I 07:33 0:00 \_ [kworker/5:1-dio/dm-0] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 38161 0.0 0.0 0 0 ? I 07:33 0:00 \_ [kworker/4:1-mm_percpu_wq] 2024-01-23T08:18:18.654 INFO:teuthology.orchestra.run.smithi173.stdout:root 38184 0.0 0.0 0 0 ? I 07:33 0:00 \_ [kworker/0:26-events] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38188 0.0 0.0 0 0 ? I 07:33 0:00 \_ [kworker/6:1-mm_percpu_wq] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38217 0.0 0.0 0 0 ? I 07:54 0:00 \_ [kworker/1:0-mm_percpu_wq] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38219 0.0 0.0 0 0 ? I 07:54 0:00 \_ [kworker/3:0-cgroup_destroy] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38222 0.0 0.0 0 0 ? I 07:58 0:00 \_ [kworker/u16:3-events_unbound] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38237 0.0 0.0 0 0 ? I 08:07 0:00 \_ [kworker/1:2-events_power_efficient] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38238 0.0 0.0 0 0 ? I 08:10 0:00 \_ [kworker/u16:1-flush-8:0] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38240 0.0 0.0 0 0 ? I 08:10 0:00 \_ [kworker/2:2-mm_percpu_wq] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38241 0.0 0.0 0 0 ? I 08:11 0:00 \_ [kworker/0:0-mm_percpu_wq] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38242 0.0 0.0 0 0 ? I 08:13 0:00 \_ [kworker/3:2-mm_percpu_wq] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 38260 0.0 0.0 0 0 ? I 08:18 0:00 \_ [kworker/u16:2-flush-8:0] 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 1 0.0 0.0 175180 19088 ? Ss 06:58 0:03 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 575 0.0 0.0 26820 14464 ? Ss 06:58 0:00 /usr/lib/systemd/systemd-journald 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:root 593 0.0 0.0 37292 15356 ? Ss 06:58 0:00 /usr/lib/systemd/systemd-udevd 2024-01-23T08:18:18.655 INFO:teuthology.orchestra.run.smithi173.stdout:rpc 668 0.0 0.0 13244 5376 ? Ss 06:58 0:00 /usr/bin/rpcbind -w -f 2024-01-23T08:18:18.656 INFO:teuthology.orchestra.run.smithi173.stdout:root 675 0.0 0.0 91824 4480 ? S, line 50) 2024-01-23T08:18:19.179 INFO:tasks.ceph:Archiving crash dumps... 2024-01-23T08:18:19.181 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/crash to /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433/remote/smithi116/crash 2024-01-23T08:18:19.182 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-23T08:18:19.219 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433/remote/smithi173/crash 2024-01-23T08:18:19.220 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-23T08:18:19.344 INFO:tasks.ceph:Compressing logs... 2024-01-23T08:18:19.344 DEBUG:teuthology.orchestra.run.smithi116:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-23T08:18:19.347 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34577.log 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34537.log 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34497.log 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34577.log.gz 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34537.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34497.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34537.log.gz 2024-01-23T08:18:19.381 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr: 55.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34497.log.gz 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr: 69.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34657.log 2024-01-23T08:18:19.382 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34657.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34457.log 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34657.log.gz 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mgr.x.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34697.log 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34457.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34697.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34457.log.gz 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34697.log.gz 2024-01-23T08:18:19.383 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34617.log 2024-01-23T08:18:19.386 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mon.b.log: 92.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-23T08:18:19.393 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.34617.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34617.log.gz 2024-01-23T08:18:19.393 INFO:teuthology.orchestra.run.smithi173.stderr: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-23T08:18:19.415 INFO:teuthology.orchestra.run.smithi173.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-23T08:18:19.422 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41458.log 2024-01-23T08:18:19.422 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108518.log 2024-01-23T08:18:19.422 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-23T08:18:19.422 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41458.log: /var/log/ceph/ceph-client.admin.108518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108980.log 2024-01-23T08:18:19.422 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41681.log 2024-01-23T08:18:19.422 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108518.log.gz 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41328.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108980.log: /var/log/ceph/ceph-client.admin.41681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38476.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108980.log.gz 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40084.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41376.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40084.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38476.log.gz 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39023.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41376.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.108686.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40084.log.gz 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108139.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108686.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39023.log.gz 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40998.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40552.log 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108686.log.gz 2024-01-23T08:18:19.423 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108139.log: /var/log/ceph/ceph-client.admin.40998.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108139.log.gz 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41375.log 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40552.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41375.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41328.log.gz 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.41458.log.gz 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41376.log.gz 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.41375.log.gz 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/valgrind/mon.c.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr: 63.9% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-01-23T08:18:19.424 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/valgrind/osd.0.log: /var/log/ceph/valgrind/osd.1.log: 63.9% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81044.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/valgrind/osd.3.log: 69.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41330.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr: 64.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.81044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40747.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41367.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71670.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41367.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.41330.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.81044.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.40552.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35938.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.71670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38574.log 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41367.log.gz 2024-01-23T08:18:19.425 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.35938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.71670.log.gz 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35938.log.gz 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66139.log 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38574.log: /var/log/ceph/ceph-client.admin.40538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108181.log 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.66139.log: gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38574.log.gz 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39417.log 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39843.log 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39417.log: /var/log/ceph/ceph-client.admin.108181.log: 87.6% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108181.log.gz 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39417.log.gz 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40052.log 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66141.log 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr: 88.0% 90.6% -- replaced with /var/log/ceph/ceph-client.admin.66139.log.gz 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39843.log.gz 2024-01-23T08:18:19.426 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108728.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40052.log.gz/var/log/ceph/ceph-client.admin.66141.log: 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40895.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38799.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108728.log.gz 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40895.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.66141.log.gz 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39273.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41633.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39273.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38799.log.gz 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39273.log.gz 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41192.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39675.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41192.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.40998.log.gz 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40616.log 2024-01-23T08:18:19.427 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39675.log.gz 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39013.log 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40616.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40895.log.gz 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.41681.log.gz 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40954.log 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.audit.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39013.log.gz 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40829.log 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40954.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.40616.log.gz 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.41192.log.gz 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39363.log 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39262.log 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39363.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39363.log.gz 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41735.log 2024-01-23T08:18:19.428 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39262.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39262.log.gz 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40227.log 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94482.log 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41735.log: /var/log/ceph/ceph-client.admin.40227.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40227.log.gz 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40143.log 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.94482.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.41735.log.gz 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41575.log 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40143.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40143.log.gz 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94482.log.gz 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108307.log 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41708.log 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108307.log: /var/log/ceph/ceph-client.admin.41575.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108307.log.gz 2024-01-23T08:18:19.429 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94487.log 2024-01-23T08:18:19.445 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41708.log: 95.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.40829.log.gz 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41256.log 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.94487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34863.log 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.41575.log.gz 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.34863.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34863.log.gz 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108391.log 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40767.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.94487.log.gz 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71453.log 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108391.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.41256.log.gz 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-23T08:18:19.446 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108391.log.gz 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.71453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94481.log 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.1.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.71453.log.gz 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38619.log 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.94481.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.94481.log.gz 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.41633.log.gz 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38248.log 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38619.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41708.log.gz 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38757.log 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38248.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38619.log.gz 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39635.log 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38248.log.gz/var/log/ceph/ceph-client.admin.38757.log: 2024-01-23T08:18:19.447 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39274.log 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39635.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38757.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39018.log 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38715.log 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39274.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39635.log.gz 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39595.log 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39274.log.gz 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38715.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39018.log.gz 2024-01-23T08:18:19.448 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108265.log 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108434.log 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38715.log.gz 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39595.log: /var/log/ceph/ceph-client.admin.108265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39595.log.gz 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108265.log.gz 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36938.log 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr:gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108434.log.gz 2024-01-23T08:18:19.449 INFO:teuthology.orchestra.run.smithi116.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.108896.log 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr:gzip/var/log/ceph/ceph-client.admin.34561.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71669.log 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108896.log: /var/log/ceph/ceph-client.admin.36938.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36938.log.gz 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108896.log.gz 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102459.log 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108854.log 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.71669.log: /var/log/ceph/ceph-client.admin.102459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41698.log 2024-01-23T08:18:19.450 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108854.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108854.log.gz 2024-01-23T08:18:19.456 INFO:teuthology.orchestra.run.smithi116.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.71669.log.gz 2024-01-23T08:18:19.456 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39991.log 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41698.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.102459.log.gz 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40185.log 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39011.log 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40185.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39991.log.gz 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40185.log.gz 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39017.log 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39011.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39011.log.gz 2024-01-23T08:18:19.457 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41050.log 2024-01-23T08:18:19.458 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39017.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-23T08:18:19.458 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41050.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39017.log.gz 2024-01-23T08:18:19.458 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39787.log 2024-01-23T08:18:19.465 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.3.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.41050.log.gz 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41431.log 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39787.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39787.log.gz 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.41698.log.gz 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39012.log 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34965.log 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39012.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41431.log.gz 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39012.log.gz 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39978.log 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.34965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39553.log 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39978.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34965.log.gz 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39978.log.gz 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39712.log 2024-01-23T08:18:19.466 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39021.log 2024-01-23T08:18:19.467 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39553.log: /var/log/ceph/ceph-client.admin.39712.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39553.log.gz 2024-01-23T08:18:19.467 INFO:teuthology.orchestra.run.smithi116.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39712.log.gz 2024-01-23T08:18:19.467 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41063.log 2024-01-23T08:18:19.467 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39021.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39021.log.gz 2024-01-23T08:18:19.467 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108812.log 2024-01-23T08:18:19.469 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39022.log 2024-01-23T08:18:19.469 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41063.log: /var/log/ceph/ceph-client.admin.108812.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108812.log.gz 2024-01-23T08:18:19.469 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40947.log 2024-01-23T08:18:19.469 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39022.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39022.log.gz 2024-01-23T08:18:19.469 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94480.log 2024-01-23T08:18:19.475 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40947.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.41063.log.gz 2024-01-23T08:18:19.476 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28695.log 2024-01-23T08:18:19.477 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.94480.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.40947.log.gz 2024-01-23T08:18:19.477 INFO:teuthology.orchestra.run.smithi116.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2024-01-23T08:18:19.478 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-01-23T08:18:19.479 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.tmp-client.admin.28695.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-23T08:18:19.479 INFO:teuthology.orchestra.run.smithi116.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28695.log.gz 2024-01-23T08:18:19.479 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81046.log 2024-01-23T08:18:19.479 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mgr.y.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.94480.log.gz 2024-01-23T08:18:19.479 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71454.log 2024-01-23T08:18:19.482 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.81046.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.81046.log.gz 2024-01-23T08:18:19.483 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40599.log 2024-01-23T08:18:19.484 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.71454.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.71454.log.gz 2024-01-23T08:18:19.484 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39297.log 2024-01-23T08:18:19.491 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40599.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2024-01-23T08:18:19.493 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108560.log 2024-01-23T08:18:19.494 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39297.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39297.log.gz 2024-01-23T08:18:19.506 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102463.log 2024-01-23T08:18:19.507 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108560.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108560.log.gz 2024-01-23T08:18:19.518 INFO:teuthology.orchestra.run.smithi116.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2024-01-23T08:18:19.519 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41675.log 2024-01-23T08:18:19.519 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.102463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2024-01-23T08:18:19.522 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41675.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.102463.log.gz 2024-01-23T08:18:19.523 INFO:teuthology.orchestra.run.smithi116.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.41675.log.gz 2024-01-23T08:18:19.532 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39258.log 2024-01-23T08:18:19.533 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2024-01-23T08:18:19.533 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39258.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39258.log.gz 2024-01-23T08:18:19.540 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108476.log 2024-01-23T08:18:19.542 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41127.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2024-01-23T08:18:19.542 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108602.log 2024-01-23T08:18:19.543 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108476.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108476.log.gz 2024-01-23T08:18:19.544 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39715.log 2024-01-23T08:18:19.544 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108602.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108602.log.gz 2024-01-23T08:18:19.545 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102464.log 2024-01-23T08:18:19.546 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39715.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39715.log.gz 2024-01-23T08:18:19.546 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41335.log 2024-01-23T08:18:19.549 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.102464.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2024-01-23T08:18:19.549 INFO:teuthology.orchestra.run.smithi116.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.40599.log.gz 2024-01-23T08:18:19.554 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108938.log 2024-01-23T08:18:19.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81045.log 2024-01-23T08:18:19.554 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108938.log: 91.0% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41335.log.gz 2024-01-23T08:18:19.554 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102464.log.gz 2024-01-23T08:18:19.554 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39931.log 2024-01-23T08:18:19.555 INFO:teuthology.orchestra.run.smithi116.stderr: 87.2%/var/log/ceph/ceph-client.admin.81045.log: -- replaced with /var/log/ceph/ceph-client.admin.108938.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-23T08:18:19.555 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:18:19.555 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41718.log 2024-01-23T08:18:19.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39931.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108223.log 2024-01-23T08:18:19.555 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41718.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39931.log.gz 2024-01-23T08:18:19.555 INFO:teuthology.orchestra.run.smithi116.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.81045.log.gz 2024-01-23T08:18:19.556 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40802.log 2024-01-23T08:18:19.558 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108223.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108223.log.gz 2024-01-23T08:18:19.558 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108644.log 2024-01-23T08:18:19.572 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40802.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-23T08:18:19.574 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108644.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108644.log.gz 2024-01-23T08:18:19.574 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41377.log 2024-01-23T08:18:19.577 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph.log: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.41718.log.gz 2024-01-23T08:18:19.586 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40739.log 2024-01-23T08:18:19.590 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41377.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.41377.log.gz 2024-01-23T08:18:19.590 INFO:teuthology.orchestra.run.smithi116.stderr: 92.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-23T08:18:19.590 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71455.log 2024-01-23T08:18:19.597 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40739.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.40739.log.gz 2024-01-23T08:18:19.597 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94486.log 2024-01-23T08:18:19.600 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.71455.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.71455.log.gz 2024-01-23T08:18:19.600 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38841.log 2024-01-23T08:18:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.94486.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94486.log.gz 2024-01-23T08:18:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-23T08:18:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38841.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38841.log.gz 2024-01-23T08:18:19.606 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39359.log 2024-01-23T08:18:19.617 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40573.log 2024-01-23T08:18:19.618 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39359.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39359.log.gz 2024-01-23T08:18:19.632 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-01-23T08:18:19.641 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41738.log 2024-01-23T08:18:19.645 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41111.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.40573.log.gz 2024-01-23T08:18:19.664 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108349.log 2024-01-23T08:18:19.675 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109020.log 2024-01-23T08:18:19.676 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108349.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108349.log.gz 2024-01-23T08:18:19.690 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66140.log 2024-01-23T08:18:19.690 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.109020.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109020.log.gz 2024-01-23T08:18:19.698 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35092.log 2024-01-23T08:18:19.707 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.66140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108097.log 2024-01-23T08:18:19.713 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.35092.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66140.log.gz 2024-01-23T08:18:19.716 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108770.log 2024-01-23T08:18:19.717 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108097.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35092.log.gz 2024-01-23T08:18:19.725 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40519.log 2024-01-23T08:18:19.729 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.108770.log: 87.6% 87.1% -- replaced with /var/log/ceph/ceph-client.admin.108097.log.gz 2024-01-23T08:18:19.738 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108770.log.gz 2024-01-23T08:18:19.747 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40907.log 2024-01-23T08:18:19.752 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40519.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-01-23T08:18:19.755 INFO:teuthology.orchestra.run.smithi116.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.41738.log.gz 2024-01-23T08:18:19.770 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38675.log 2024-01-23T08:18:19.776 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40907.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40907.log.gz 2024-01-23T08:18:19.784 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39891.log 2024-01-23T08:18:19.798 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.38675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38675.log.gz 2024-01-23T08:18:19.800 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2024-01-23T08:18:19.801 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.39891.log: 90.0% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39891.log.gz 2024-01-23T08:18:19.810 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40912.log 2024-01-23T08:18:19.813 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40612.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.40519.log.gz 2024-01-23T08:18:19.819 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41374.log 2024-01-23T08:18:19.825 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.40912.log: -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2024-01-23T08:18:19.828 INFO:teuthology.orchestra.run.smithi116.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-23T08:18:19.836 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-client.admin.41374.log: 91.4% 91.5% -- replaced with /var/log/ceph/ceph-client.admin.40912.log.gz 2024-01-23T08:18:19.845 INFO:teuthology.orchestra.run.smithi116.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41374.log.gz 2024-01-23T08:18:20.048 INFO:teuthology.orchestra.run.smithi116.stderr:/var/log/ceph/ceph-mon.c.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-23T08:18:20.143 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:20.141+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:20.265 INFO:teuthology.orchestra.run.smithi116.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.40802.log.gz 2024-01-23T08:18:20.573 INFO:teuthology.orchestra.run.smithi116.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.40747.log.gz 2024-01-23T08:18:21.049 INFO:teuthology.orchestra.run.smithi173.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-23T08:18:21.100 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:21.098+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:22.112 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:22.111+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:22.124 INFO:teuthology.orchestra.run.smithi116.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-23T08:18:22.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~21s 2024-01-23T08:18:22.730 INFO:teuthology.orchestra.run.smithi116.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-23T08:18:23.132 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:23.130+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:24.131 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:24.131+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:25.153 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:25.152+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:25.203 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/ceph-osd.7.log: file size changed while zipping 2024-01-23T08:18:25.203 INFO:teuthology.orchestra.run.smithi173.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-23T08:18:25.974 INFO:teuthology.orchestra.run.smithi173.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-23T08:18:26.143 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:26.141+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:26.447 INFO:teuthology.orchestra.run.smithi116.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-23T08:18:26.546 INFO:teuthology.orchestra.run.smithi173.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-23T08:18:26.748 INFO:teuthology.orchestra.run.smithi173.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-23T08:18:26.749 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-01-23T08:18:26.750 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m7.388s 2024-01-23T08:18:26.750 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m27.790s 2024-01-23T08:18:26.750 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.885s 2024-01-23T08:18:26.847 INFO:teuthology.orchestra.run.smithi116.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-23T08:18:27.036 INFO:teuthology.orchestra.run.smithi116.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-23T08:18:27.174 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:27.173+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:27.280 INFO:teuthology.orchestra.run.smithi116.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-23T08:18:27.282 INFO:teuthology.orchestra.run.smithi116.stderr: 2024-01-23T08:18:27.282 INFO:teuthology.orchestra.run.smithi116.stderr:real 0m7.921s 2024-01-23T08:18:27.282 INFO:teuthology.orchestra.run.smithi116.stderr:user 0m36.837s 2024-01-23T08:18:27.282 INFO:teuthology.orchestra.run.smithi116.stderr:sys 0m1.294s 2024-01-23T08:18:27.282 INFO:tasks.ceph:Archiving logs... 2024-01-23T08:18:27.282 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433/remote/smithi116/log 2024-01-23T08:18:27.283 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-23T08:18:27.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~26s 2024-01-23T08:18:28.183 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:28.178+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:29.188 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:29.183+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:30.190 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:30.186+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:31.151 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:31.143+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:32.117 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:32.108+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:32.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~31s 2024-01-23T08:18:32.631 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433/remote/smithi173/log 2024-01-23T08:18:32.632 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-23T08:18:33.118 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:33.098+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:34.092 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:34.072+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:35.138 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:35.106+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:36.126 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:36.112+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:36.874 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1112, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1181, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1163, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi173 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-01-23T08:18:36.875 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-23T08:18:36.884 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1112, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1181, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1163, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi173 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-01-23T08:18:36.885 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-23T08:18:36.885 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-23T08:18:36.888 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-23T08:18:36.975 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-23T08:18:36.984 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-23T08:18:36.985 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T08:18:36.987 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-23T08:18:37.000 INFO:teuthology.orchestra.run.smithi116.stderr:bash: line 1: ntpq: command not found 2024-01-23T08:18:37.003 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-01-23T08:18:37.005 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-23T08:18:37.005 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2024-01-23T08:18:37.005 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 55 +122us[ +161us] +/- 65ms 2024-01-23T08:18:37.005 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -1032us[ -993us] +/- 64ms 2024-01-23T08:18:37.005 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +1119us[+1158us] +/- 77ms 2024-01-23T08:18:37.005 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T08:18:37.007 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-23T08:18:37.007 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-01-23T08:18:37.007 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +100us[ +119us] +/- 65ms 2024-01-23T08:18:37.008 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -1039us[-1020us] +/- 64ms 2024-01-23T08:18:37.008 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +1103us[+1122us] +/- 77ms 2024-01-23T08:18:37.008 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-01-23T08:18:37.009 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-23T08:18:37.018 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-23T08:18:37.018 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-23T08:18:37.027 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-23T08:18:37.117 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-23T08:18:37.149 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:37.147+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:37.187 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-23T08:18:37.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:18:37.219 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-23T08:18:37.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:18:37.259 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-23T08:18:37.268 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-23T08:18:37.314 INFO:teuthology.task.internal:Duration was 4781.925769 seconds 2024-01-23T08:18:37.314 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-23T08:18:37.414 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-23T08:18:37.414 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-23T08:18:37.416 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-23T08:18:37.459 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-23T08:18:37.462 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-23T08:18:37.516 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~36s 2024-01-23T08:18:37.967 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-23T08:18:37.967 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2024-01-23T08:18:37.967 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-23T08:18:37.987 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-01-23T08:18:37.988 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-23T08:18:38.013 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-23T08:18:38.013 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-23T08:18:38.030 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-23T08:18:38.082 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-23T08:18:38.083 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-23T08:18:38.099 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-23T08:18:38.156 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:38.155+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:38.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-23T08:18:38.235 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-23T08:18:38.235 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-23T08:18:38.262 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-23T08:18:38.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-23T08:18:38.303 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-23T08:18:38.305 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-23T08:18:38.328 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2024-01-23T08:18:38.357 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-01-23T08:18:38.750 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-23T08:18:38.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:18:38.765 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-23T08:18:38.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:18:38.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-23T08:18:38.815 INFO:teuthology.task.internal:Transferring archived files... 2024-01-23T08:18:38.816 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433/remote/smithi116 2024-01-23T08:18:38.816 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-23T08:18:38.874 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433/remote/smithi173 2024-01-23T08:18:38.874 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-23T08:18:38.915 INFO:teuthology.task.internal:Removing archive directory... 2024-01-23T08:18:38.915 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-23T08:18:38.918 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-23T08:18:38.962 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-23T08:18:38.976 INFO:teuthology.task.internal:Not uploading archives. 2024-01-23T08:18:38.976 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-23T08:18:39.003 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-23T08:18:39.003 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-23T08:18:39.005 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-23T08:18:39.017 INFO:teuthology.orchestra.run.smithi116.stdout: 265292 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 23 08:18 /home/ubuntu/cephtest 2024-01-23T08:18:39.018 INFO:teuthology.orchestra.run.smithi116.stdout: 524326 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 23 07:31 /home/ubuntu/cephtest/ceph.data 2024-01-23T08:18:39.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-23T08:18:39.019 INFO:teuthology.orchestra.run.smithi116.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-01-23T08:18:39.019 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1112, in cluster yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1449, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 329, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1181, in cluster raise e File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1163, in cluster remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi173 with status 32: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_1d1563036928048a487b8d17bdf66baca01c75bf/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi116 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-01-23T08:18:39.020 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-23T08:18:39.111 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-23T08:18:39.165 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun 2024-01-23T08:18:39.165 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T08:18:39.169 INFO:teuthology.orchestra.run.smithi173.stdout: 265930 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jan 23 08:18 /home/ubuntu/cephtest 2024-01-23T08:18:39.169 INFO:teuthology.orchestra.run.smithi173.stdout: 917536 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 23 07:31 /home/ubuntu/cephtest/ceph.data 2024-01-23T08:18:39.170 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-01-23T08:18:39.170 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:39.112+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:39.194 DEBUG:teuthology.nuke:shortname: smithi116 2024-01-23T08:18:39.194 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T08:18:39.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 06:50:40.353073', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC9TEWxN1NGcMkFCTgCvj3qTbkRXD6fdhbu7qOmOtqmb3+jCmrHEDFlitH/mip68KBt3XQtS0M5RDAV6xyi5Mbk='} 2024-01-23T08:18:39.219 DEBUG:teuthology.nuke:shortname: smithi173 2024-01-23T08:18:39.219 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T08:18:39.242 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-22_23:24:57-rados-wip-yuri7-testing-2024-01-18-1327-distro-default-smithi/7527433', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 06:50:40.351383', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIKm7cizsa8IsSxtJo3rYn0ZL1q4EpDm5/ATvaXoFsqnwlW5KKmqctKYU6EIxoIq83QCTCMz8oKx+93C4cJmu0w='} 2024-01-23T08:18:39.266 INFO:teuthology.orchestra.console.smithi116:Power off 2024-01-23T08:18:39.267 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T08:18:39.296 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-01-23T08:18:39.296 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:18:39.312 INFO:teuthology.orchestra.console.smithi173:Power off 2024-01-23T08:18:39.312 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T08:18:39.321 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-23T08:18:39.334 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-01-23T08:18:39.335 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:18:39.359 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-01-23T08:18:40.086 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:40.086+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:41.082 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:41.081+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:42.090 INFO:tasks.ceph.osd.7.smithi173.stderr:2024-01-23T08:18:42.089+0000 ec4e640 -1 osd.7 1335 heartbeat_check: no reply from 172.21.15.173:6820 osd.6 since back 2024-01-23T08:12:57.463780+0000 front 2024-01-23T08:12:57.465279+0000 (oldest deadline 2024-01-23T08:14:20.263171+0000) 2024-01-23T08:18:42.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~41s 2024-01-23T08:18:43.323 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:18:43.360 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:18:43.434 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-23T08:18:43.471 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-01-23T08:18:47.439 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:18:47.472 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:18:47.552 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-23T08:18:47.583 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-01-23T08:18:47.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~46s 2024-01-23T08:18:47.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-01-23T08:18:47.653 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-01-23T08:18:47.684 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-01-23T08:18:47.789 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} duration: 4781.925769329071 failure_reason: 'valgrind error: Leak_StillReachable operator new[](unsigned long) UnknownInlinedFun UnknownInlinedFun' flavor: default owner: scheduled_lflores@teuthology status: fail success: false 2024-01-23T08:18:47.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:18:47.863 INFO:teuthology.run:FAIL